Jun 03 14:35:26 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 14:35:26 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 14:35:26 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 14:35:27 devstack cinder-volume[75836]: INFO dbcounter [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Registered counter for database cinder Jun 03 14:35:27 devstack cinder-volume[75836]: DEBUG oslo_db.sqlalchemy.engines [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:35:27 devstack cinder-volume[75836]: DEBUG dbcounter [-] [75836] Writer thread running {{(pid=75836) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 14:35:27 devstack cinder-volume[75836]: INFO cinder.rpc [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 03 14:35:27 devstack cinder-volume[75836]: INFO cinder.rpc [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 03 14:35:27 devstack cinder-volume[75836]: DEBUG oslo_db.sqlalchemy.engines [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:35:27 devstack cinder-volume[75836]: INFO cinder.volume.manager [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Determined volume DB was empty at startup. Jun 03 14:35:27 devstack cinder-volume[75836]: DEBUG cinder.volume.manager [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75836) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 03 14:35:27 devstack cinder-volume[75836]: INFO cinder.volume.manager [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 03 14:35:27 devstack cinder-volume[75836]: WARNING stevedore.named [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 03 14:35:27 devstack cinder-volume[75836]: WARNING castellan.key_manager [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 14:35:27 devstack cinder-volume[75836]: WARNING cinder.keymgr.conf_key_mgr [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 14:35:27 devstack cinder-volume[75836]: DEBUG cinder.volume.drivers.lvm [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75836) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 03 14:35:27 devstack cinder-volume[75836]: DEBUG oslo_concurrency.processutils [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75836) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_concurrency.processutils [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] CMD "cinder-rtstool verify" returned: 0 in 0.374s {{(pid=75836) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_db.sqlalchemy.engines [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:35:28 devstack cinder-volume[75836]: INFO cinder.rpc [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 03 14:35:28 devstack cinder-volume[75836]: INFO cinder.rpc [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 03 14:35:28 devstack cinder-volume[75836]: WARNING stevedore.named [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 03 14:35:28 devstack cinder-volume[75836]: WARNING castellan.key_manager [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 14:35:28 devstack cinder-volume[75836]: INFO cinder.volume.manager [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_db.sqlalchemy.engines [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:35:28 devstack cinder-volume[75836]: INFO oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Starting 1 workers Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Started child 76012 {{(pid=75836) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Full set of CONF: {{(pid=75836) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] ******************************************************************************** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Configuration options gathered from: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] ================================================================================ {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 03 14:35:28 devstack cinder-volume[76012]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] allow_availability_zone_fallback = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] allow_compression_on_image_upload = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] allowed_direct_url_schemes = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] api_rate_limit = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] auth_strategy = keystone {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] az_cache_duration = 3600 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_availability_zone = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_host = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_stats_polling_interval = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backup_api_class = cinder.backup.api.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backup_name_template = backup-%s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backup_use_same_host = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backup_use_temp_snapshot = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] chap_password = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] chap_username = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cinder_internal_tenant_project_id = 2a1f962eaa804fdaa827feda095c2738 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cinder_internal_tenant_user_id = a3a6798fca1e4dc9af979f2698ba64c2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cloned_volume_same_az = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cluster = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] compression_format = gzip {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] compute_api_class = cinder.compute.nova.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] config_dir = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] config_source = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] control_exchange = openstack {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] debug = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] default_availability_zone = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] default_group_type = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] default_volume_type = lvmdriver-1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] disk_geometry = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] driver_client_cert = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] driver_client_cert_key = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] driver_data_namespace = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] driver_ssl_cert_path = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] driver_ssl_cert_verify = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] driver_use_ssl = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] enable_force_upload = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] enable_new_services = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] enable_unsupported_driver = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] enforce_multipath_for_image_xfer = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 03 14:35:28 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] filter_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance_api_insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance_api_ssl_compression = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance_ca_certificates_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance_catalog_info = image:glance:publicURL {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance_certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance_keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance_num_retries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance_request_timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] goodness_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] graceful_shutdown_timeout = 5 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] group_api_class = cinder.group.api.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] host = devstack {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] image_compress_on_upload = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] image_conversion_address_space_limit = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] image_conversion_cpu_limit = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] image_conversion_disable = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] image_upload_use_cinder_backend = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] image_upload_use_internal_tenant = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] image_volume_cache_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] image_volume_cache_max_count = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] image_volume_cache_max_size_gb = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] init_host_max_objects_retrieval = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] instance_format = [instance: %(uuid)s] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] iscsi_target_flags = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] iscsi_write_cache = on {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] iser_helper = tgtadm {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] iser_ip_address = 192.168.122.135 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] iser_port = 3260 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] log_color = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] log_config_append = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] log_dir = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] log_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] log_options = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] log_rotate_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] log_rotate_interval_type = days {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] log_rotation_type = none {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] max_age = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] max_logfile_count = 30 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] max_logfile_size_mb = 200 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] max_over_subscription_ratio = 20.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] message_reap_interval = 86400 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] message_ttl = 2592000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] migration_create_volume_timeout_secs = 300 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] monkey_patch = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] monkey_patch_modules = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] my_ip = 192.168.122.135 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] no_snapshot_gb_quota = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] num_iser_scan_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] num_shell_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] num_volume_device_scan_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] nvmeof_conn_info_version = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] nvmet_ns_id = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] nvmet_port_id = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] osapi_max_limit = 1000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] osapi_volume_ext_list = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] osapi_volume_listen_port = 8776 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] osapi_volume_use_ssl = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] osapi_volume_workers = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] per_volume_size_limit = -1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] periodic_fuzzy_delay = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] periodic_interval = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] public_endpoint = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] publish_errors = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] quota_backup_gigabytes = 1000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] quota_backups = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] quota_gigabytes = 1000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] quota_groups = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] quota_snapshots = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] quota_volumes = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] rate_limit_burst = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] rate_limit_except_level = CRITICAL {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] rate_limit_interval = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] reinit_driver_count = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] replication_device = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] report_discard_supported = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] report_interval = 120 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] reservation_clean_interval = 86400 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] reservation_expire = 86400 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] reserved_image_namespaces = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] reserved_percentage = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] rpc_response_timeout = 120 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] run_external_periodic_tasks = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] scst_target_driver = iscsi {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] scst_target_iqn_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_down_time = 720 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] shell_completion = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] snapshot_name_template = snapshot-%s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] snapshot_same_host = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] split_loggers = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] state_path = /opt/stack/data/cinder {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] storage_availability_zone = nova {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] storage_protocol = iSCSI {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] syslog_log_facility = LOG_USER {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] target_helper = lioadm {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] target_ip_address = 192.168.122.135 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] target_port = 3260 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] target_protocol = iscsi {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] target_secondary_ip_addresses = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] trace_flags = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] transport_url = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] until_refresh = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] use_chap_auth = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] use_default_quota_class = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] use_journal = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] use_json = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] use_multipath_for_image_xfer = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] use_stderr = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] use_syslog = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] verify_glance_signatures = enabled {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_api_class = cinder.volume.api.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_backend_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_clear = zero {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_clear_ionice = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_clear_size = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_copy_bps_limit = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_dd_blocksize = 1M {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_name_template = volume-%s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_service_inithost_offload = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volume_usage_audit_period = month {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] zoning_mode = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_concurrency.disable_process_locking = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.admin_password = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.admin_token = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.admin_user = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.auth_port = 35357 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.auth_protocol = https {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.auth_section = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.auth_type = password {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.auth_uri = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.auth_version = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.cache = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.identity_uri = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.include_service_catalog = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.interface = public {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_password = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcache_username = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.region_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.service_type = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.backend = dogpile.cache.null {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.backend_argument = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.backend_expiration_time = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.config_prefix = cache.oslo {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.debug_cache_backend = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.enable_retry_client = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.enable_socket_keepalive = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.enforce_fips_mode = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.expiration_time = 600 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.hashclient_retry_attempts = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.memcache_dead_retry = 300 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.memcache_pool_maxsize = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.memcache_sasl_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.password = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.proxies = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.redis_db = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.redis_server = localhost:6379 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.retry_attempts = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.retry_delay = 0.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.socket_keepalive_count = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack sudo[76016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.socket_keepalive_idle = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.socket_keepalive_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.socket_timeout = 1.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.tls_allowed_ciphers = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.tls_cafile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.tls_certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.tls_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack sudo[76016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.tls_keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cache.username = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.asyncio_connection = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.asyncio_slave_connection = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.backend = sqlalchemy {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.connection = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.connection_debug = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.connection_parameters = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.connection_recycle_time = 3600 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.connection_trace = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.db_inc_retry_interval = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.db_max_retries = 20 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.db_max_retry_interval = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.db_retry_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.max_overflow = 50 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.max_pool_size = 5 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.max_retries = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.mysql_wsrep_sync_wait = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.pool_timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.retry_interval = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.slave_connection = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.sqlite_synchronous = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.synchronous_reader = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] database.use_db_reconnect = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.connection_string = messaging:// {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.es_doc_type = notification {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.es_scroll_size = 10000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.es_scroll_time = 2m {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.filter_error_trace = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.hmac_keys = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.sentinel_service_name = mymaster {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.socket_timeout = 0.1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.trace_requests = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler.trace_sqlalchemy = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler_jaeger.process_tags = {} {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler_jaeger.service_name_prefix = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] profiler_otlp.service_name_prefix = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.enforce_new_defaults = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: WARNING oslo_config.cfg [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.enforce_scope = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.policy_default_rule = default {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.policy_file = policy.yaml {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] coordination.backend_url = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] privsep_osbrick.group = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] privsep_osbrick.helper_command = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] privsep_osbrick.user = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cinder_sys_admin.group = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cinder_sys_admin.helper_command = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] cinder_sys_admin.user = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_user.auth_section = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_user.auth_type = password {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_user.cafile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_user.certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_user.collect_timing = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_user.insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_user.keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_user.send_service_user_token = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_user.split_loggers = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] service_user.timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance.auth_section = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance.auth_type = password {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance.certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance.collect_timing = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance.insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance.keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance.region_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance.split_loggers = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] glance.timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.backend_availability_zone = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.chap_password = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.chap_username = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.disk_geometry = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.driver_client_cert = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.driver_client_cert_key = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.driver_data_namespace = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.driver_use_ssl = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.extra_capabilities = {} {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.filter_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.goodness_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.iscsi_target_flags = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.iscsi_write_cache = on {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.iser_helper = tgtadm {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.iser_port = 3260 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.lvm_share_target = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.lvm_type = auto {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.num_shell_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.replication_device = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.report_discard_supported = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.reserved_percentage = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.target_helper = tgtadm {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.target_port = 3260 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.target_protocol = iscsi {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.trace_flags = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.unique_fqdn_network = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.use_chap_auth = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.volume_backend_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.volume_clear = zero {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.volume_clear_ionice = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.volume_clear_size = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_reports.file_event_handler = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_reports.log_dir = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.backend_host = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.chap_password = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.chap_username = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.disk_geometry = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.driver_client_cert = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.extra_capabilities = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.filter_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.goodness_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.iser_helper = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.iser_ip_address = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.iser_port = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.lvm_share_target = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.lvm_type = auto {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.num_shell_tries = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.replication_device = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.report_discard_supported = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.reserved_percentage = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.scst_target_driver = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.storage_protocol = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.target_helper = lioadm {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.target_ip_address = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.target_port = 3260 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:28 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.trace_flags = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.use_chap_auth = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.volume_clear = zero {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.volume_clear_size = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] lvmdriver-1.volumes_dir = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.ssl = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_notifications.driver = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_notifications.retry = -1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] key_manager.fixed_key = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.barbican_api_version = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.barbican_endpoint = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.barbican_endpoint_type = public {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.barbican_region_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.cafile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.collect_timing = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.number_of_retries = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.retry_delay = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.send_service_user_token = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.split_loggers = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.verify_ssl = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican.verify_ssl_path = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican_service_user.auth_section = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican_service_user.auth_type = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican_service_user.cafile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican_service_user.certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican_service_user.collect_timing = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican_service_user.insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican_service_user.keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican_service_user.split_loggers = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] barbican_service_user.timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.approle_role_id = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.approle_secret_id = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.kv_mountpoint = secret {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.kv_path = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.kv_version = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.namespace = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.root_token_id = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.ssl_ca_crt_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.timeout = 60.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.use_ssl = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:35:29 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] ******************************************************************************** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 03 14:35:29 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.860s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:29 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:29 devstack sudo[76016]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:29 devstack sudo[76288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:35:29 devstack sudo[76288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:29 devstack sudo[76288]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:29 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.623s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:29 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:35:29 devstack cinder-volume[76012]: INFO cinder.brick.local_dev.lvm [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 03 14:35:29 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:29 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:29 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:29 devstack sudo[76487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 14:35:29 devstack sudo[76487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:30 devstack sudo[76487]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:30 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:30 devstack cinder-volume[76012]: DEBUG cinder.brick.local_dev.lvm [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76012) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 03 14:35:30 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:30 devstack sudo[76586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:35:30 devstack sudo[76586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:31 devstack sudo[76586]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:31 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.000s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:31 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:31 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:31 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:31 devstack sudo[76785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:35:31 devstack sudo[76785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:32 devstack sudo[76785]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:32 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.738s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:32 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:32 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:32 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:32 devstack sudo[76789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 03 14:35:32 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:33 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:33 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.955s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:33 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:33 devstack sudo[76801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 14:35:33 devstack sudo[76801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:34 devstack sudo[76801]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:34 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:34 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:34 devstack sudo[76804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 14:35:34 devstack sudo[76804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:34 devstack sudo[76804]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:34 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:34 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:34 devstack sudo[76809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:35:34 devstack sudo[76809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:35 devstack sudo[76809]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:35 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:35 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:35 devstack sudo[76812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:35:35 devstack sudo[76812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:36 devstack sudo[76812]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:36 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.814s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:36 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:36 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:36 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:36 devstack sudo[76851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:35:36 devstack sudo[76851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:36 devstack sudo[76851]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:36 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:36 devstack cinder-volume[76012]: INFO cinder.volume.drivers.lvm [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 03 14:35:36 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:37 devstack sudo[76939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:35:37 devstack sudo[76939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:37 devstack sudo[76939]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:37 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 14:35:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:37 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 14:35:37 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:38 devstack cinder-volume[75836]: DEBUG dbcounter [-] [75836] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75836) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:35:38 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:38 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:38 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:38 devstack sudo[77085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:35:38 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:38 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:38 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:38 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:38 devstack sudo[77092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:35:38 devstack sudo[77092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:39 devstack sudo[77092]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:39 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.576s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:39 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:39 devstack sudo[77095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:35:39 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:40 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:40 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:40 devstack cinder-volume[76012]: INFO cinder.volume.driver [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Driver hasn't implemented _init_vendor_properties() Jun 03 14:35:40 devstack cinder-volume[76012]: DEBUG cinder.volume.driver [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76012) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 03 14:35:40 devstack cinder-volume[76012]: DEBUG oslo_db.sqlalchemy.engines [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:35:40 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writer thread running {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 14:35:40 devstack cinder-volume[76012]: DEBUG cinder.db.sqlalchemy.api [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Building query based on filter {{(pid=76012) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 03 14:35:40 devstack cinder-volume[76012]: DEBUG cinder.image.image_utils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76012) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 03 14:35:40 devstack cinder-volume[76012]: INFO cinder.keymgr.migration [None req-8aa8a724-8976-4de9-8c89-a8ae76ffa78f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 03 14:35:40 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 14:35:40 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:40 devstack sudo[77099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 14:35:40 devstack sudo[77099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:40 devstack sudo[77099]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:40 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:40 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:40 devstack sudo[77102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:35:40 devstack sudo[77102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:41 devstack sudo[77102]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:41 devstack sudo[77105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:35:41 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:41 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:41 devstack sudo[77112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:35:41 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:42 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:42 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:35:42 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Driver initialization completed successfully. Jun 03 14:35:42 devstack cinder-volume[76012]: INFO cinder.manager [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Initiating service 2 cleanup Jun 03 14:35:42 devstack cinder-volume[76012]: INFO cinder.manager [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Service 2 cleanup completed. Jun 03 14:35:42 devstack cinder-volume[76012]: DEBUG cinder.service [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Creating RPC server for service cinder-volume {{(pid=76012) start /opt/stack/cinder/cinder/service.py:231}} Jun 03 14:35:42 devstack cinder-volume[76012]: DEBUG cinder.service [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76012) start /opt/stack/cinder/cinder/service.py:237}} Jun 03 14:35:42 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 03 14:35:42 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 14:35:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:42 devstack sudo[77117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 14:35:42 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:43 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:43 devstack sudo[77120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:35:43 devstack sudo[77120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:43 devstack sudo[77120]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:44 devstack sudo[77177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:35:44 devstack sudo[77177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:44 devstack sudo[77177]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:44 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.599s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:44 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:35:44 devstack sudo[77180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:35:44 devstack sudo[77180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:35:45 devstack sudo[77180]: pam_unix(sudo:session): session closed for user root Jun 03 14:35:45 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.595s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:35:45 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-baa2c90b-5806-40de-933d-07bfb1cf46ee None None] Driver post RPC initialization completed successfully. Jun 03 14:35:55 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=4 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:35:55 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:36:41 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:36:41 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 14:36:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:36:41 devstack sudo[79114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 14:36:41 devstack sudo[79114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:36:41 devstack sudo[79114]: pam_unix(sudo:session): session closed for user root Jun 03 14:36:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.581s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:36:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:36:41 devstack sudo[79117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:36:41 devstack sudo[79117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:36:42 devstack sudo[79117]: pam_unix(sudo:session): session closed for user root Jun 03 14:36:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:36:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:36:42 devstack sudo[79122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:36:42 devstack sudo[79122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:36:43 devstack sudo[79122]: pam_unix(sudo:session): session closed for user root Jun 03 14:36:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:36:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:36:43 devstack sudo[79222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:36:43 devstack sudo[79222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:36:43 devstack sudo[79222]: pam_unix(sudo:session): session closed for user root Jun 03 14:36:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:36:43 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:36:43 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running periodic task VolumeManager._thread_info {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:36:43 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] thread count: 6 {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:36:43 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] thread info: [<_MainThread(MainThread, started 131067901927552)>, , , , , ] {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:37:41 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:37:41 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 14:37:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:37:41 devstack sudo[82226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 14:37:41 devstack sudo[82226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:37:41 devstack sudo[82226]: pam_unix(sudo:session): session closed for user root Jun 03 14:37:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:37:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:37:41 devstack sudo[82229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:37:41 devstack sudo[82229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:37:42 devstack sudo[82229]: pam_unix(sudo:session): session closed for user root Jun 03 14:37:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:37:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:37:42 devstack sudo[82232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:37:42 devstack sudo[82232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:37:42 devstack sudo[82232]: pam_unix(sudo:session): session closed for user root Jun 03 14:37:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.586s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:37:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:37:42 devstack sudo[82235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:37:43 devstack sudo[82235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:37:43 devstack sudo[82235]: pam_unix(sudo:session): session closed for user root Jun 03 14:37:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:37:43 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:37:55 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:37:55 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:UPDATE=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:38:41 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:38:41 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 14:38:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:38:41 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 14:38:41 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:38:41 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Jun 03 14:38:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:38:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:38:41 devstack sudo[84043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:38:41 devstack sudo[84043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:38:42 devstack sudo[84043]: pam_unix(sudo:session): session closed for user root Jun 03 14:38:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.596s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:38:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:38:42 devstack sudo[84046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:38:42 devstack sudo[84046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:38:43 devstack sudo[84046]: pam_unix(sudo:session): session closed for user root Jun 03 14:38:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.615s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:38:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:38:43 devstack sudo[84049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:38:43 devstack sudo[84049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:38:43 devstack sudo[84049]: pam_unix(sudo:session): session closed for user root Jun 03 14:38:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:38:43 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:38:43 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running periodic task VolumeManager._thread_info {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:38:43 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] thread count: 6 {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:38:43 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] thread info: [<_MainThread(MainThread, started 131067901927552)>, , , , , ] {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:39:41 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:39:41 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 14:39:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:39:41 devstack sudo[85096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 14:39:41 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:39:41 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root Jun 03 14:39:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:39:41 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:39:41 devstack sudo[85100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:39:41 devstack sudo[85100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:39:42 devstack sudo[85100]: pam_unix(sudo:session): session closed for user root Jun 03 14:39:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:39:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:39:42 devstack sudo[85116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 14:39:42 devstack sudo[85116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:39:42 devstack sudo[85116]: pam_unix(sudo:session): session closed for user root Jun 03 14:39:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:39:42 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:39:43 devstack sudo[85123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 14:39:43 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:39:43 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root Jun 03 14:39:43 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:39:43 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-c9e9a5ac-696b-4061-b734-f36ee8635d3f None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:39:55 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:39:55 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:UPDATE=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:40:06 devstack cinder-volume[75836]: INFO oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Caught SIGTERM, stopping children Jun 03 14:40:06 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Acquiring lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 14:40:06 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Acquired lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 14:40:06 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Releasing lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 14:40:06 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Stop services. {{(pid=75836) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 03 14:40:06 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Killing children. {{(pid=75836) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 03 14:40:06 devstack cinder-volume[75836]: INFO oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Waiting on 1 children to exit Jun 03 14:40:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Acquiring lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 14:40:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Acquired lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 14:40:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Releasing lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 14:40:07 devstack cinder-volume[76012]: WARNING amqp [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 03 14:40:07 devstack cinder-volume[76012]: WARNING amqp [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 03 14:40:07 devstack cinder-volume[75836]: INFO oslo_service.backend._eventlet.service [None req-aca62584-fde4-4c30-a8e8-02c93f3ad701 None None] Child 76012 exited with status 0 Jun 03 14:40:10 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 14:40:10 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 14:40:10 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 14:40:10 devstack cinder-volume[85724]: INFO dbcounter [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Registered counter for database cinder Jun 03 14:40:10 devstack cinder-volume[85724]: DEBUG oslo_db.sqlalchemy.engines [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:40:10 devstack cinder-volume[85724]: DEBUG dbcounter [-] [85724] Writer thread running {{(pid=85724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 14:40:10 devstack cinder-volume[85724]: INFO cinder.rpc [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 03 14:40:10 devstack cinder-volume[85724]: INFO cinder.rpc [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 03 14:40:10 devstack cinder-volume[85724]: DEBUG oslo_db.sqlalchemy.engines [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:40:11 devstack cinder-volume[85724]: INFO cinder.volume.manager [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Determined volume DB was empty at startup. Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG cinder.volume.manager [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85724) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 03 14:40:11 devstack cinder-volume[85724]: INFO cinder.volume.manager [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 03 14:40:11 devstack cinder-volume[85724]: WARNING stevedore.named [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 03 14:40:11 devstack cinder-volume[85724]: WARNING castellan.key_manager [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 14:40:11 devstack cinder-volume[85724]: WARNING cinder.keymgr.conf_key_mgr [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 14:40:11 devstack cinder-volume[85724]: INFO cinder.volume.manager [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_db.sqlalchemy.engines [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:40:11 devstack cinder-volume[85724]: INFO oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Starting 1 workers Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Started child 85890 {{(pid=85724) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Full set of CONF: {{(pid=85724) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] ******************************************************************************** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Configuration options gathered from: {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] ================================================================================ {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] allow_availability_zone_fallback = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] allow_compression_on_image_upload = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] allowed_direct_url_schemes = [] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] api_rate_limit = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] auth_strategy = keystone {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_availability_zone = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_host = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_name = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_stats_polling_interval = 60 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backup_api_class = cinder.backup.api.API {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backup_name_template = backup-%s {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backup_use_same_host = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backup_use_temp_snapshot = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] chap_password = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] chap_username = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85890]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cinder_internal_tenant_project_id = 2a1f962eaa804fdaa827feda095c2738 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cinder_internal_tenant_user_id = a3a6798fca1e4dc9af979f2698ba64c2 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cluster = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] compression_format = gzip {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] compute_api_class = cinder.compute.nova.API {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] config_dir = [] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] config_source = [] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] control_exchange = openstack {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] debug = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] default_availability_zone = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] default_group_type = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] default_volume_type = QuobyteHD {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] disk_geometry = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] driver_client_cert = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] driver_client_cert_key = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] driver_data_namespace = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] driver_ssl_cert_path = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] driver_ssl_cert_verify = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] driver_use_ssl = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] enable_new_services = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] enable_unsupported_driver = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] enabled_backends = ['QuobyteHD'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] enforce_multipath_for_image_xfer = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] filter_function = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance_api_insecure = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance_api_ssl_compression = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance_ca_certificates_file = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance_catalog_info = image:glance:publicURL {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance_certfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance_keyfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance_num_retries = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance_request_timeout = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] goodness_function = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] graceful_shutdown_timeout = 5 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] group_api_class = cinder.group.api.API {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] host = devstack {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] image_compress_on_upload = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] image_conversion_address_space_limit = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] image_conversion_cpu_limit = 60 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] image_conversion_disable = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] image_upload_use_cinder_backend = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] image_upload_use_internal_tenant = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] image_volume_cache_enabled = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] image_volume_cache_max_count = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] image_volume_cache_max_size_gb = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] init_host_max_objects_retrieval = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] instance_format = [instance: %(uuid)s] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] iscsi_target_flags = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] iscsi_write_cache = on {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] iser_helper = tgtadm {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] iser_ip_address = 192.168.122.135 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] iser_port = 3260 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] log_color = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] log_config_append = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] log_dir = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] log_file = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] log_options = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] log_rotate_interval = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] log_rotate_interval_type = days {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] log_rotation_type = none {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] max_age = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] max_logfile_count = 30 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] max_logfile_size_mb = 200 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] max_over_subscription_ratio = 20.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] message_reap_interval = 86400 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] message_ttl = 2592000 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] migration_create_volume_timeout_secs = 300 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] monkey_patch = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] monkey_patch_modules = [] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] my_ip = 192.168.122.135 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] no_snapshot_gb_quota = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] num_iser_scan_tries = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] num_shell_tries = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] num_volume_device_scan_tries = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] nvmeof_conn_info_version = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] nvmet_ns_id = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] nvmet_port_id = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] osapi_max_limit = 1000 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] osapi_volume_ext_list = [] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] osapi_volume_listen_port = 8776 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] osapi_volume_use_ssl = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] osapi_volume_workers = 2 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] per_volume_size_limit = -1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] periodic_fuzzy_delay = 60 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] periodic_interval = 60 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] public_endpoint = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] publish_errors = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] quota_backup_gigabytes = 1000 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] quota_backups = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] quota_gigabytes = 1000 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] quota_groups = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] quota_snapshots = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] quota_volumes = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] rate_limit_burst = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] rate_limit_except_level = CRITICAL {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] rate_limit_interval = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] reinit_driver_count = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] replication_device = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] report_discard_supported = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] report_interval = 120 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] reservation_clean_interval = 86400 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] reservation_expire = 86400 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] reserved_image_namespaces = [] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] reserved_percentage = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] rpc_response_timeout = 120 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] run_external_periodic_tasks = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] scst_target_driver = iscsi {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] scst_target_iqn_name = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85890]: INFO cinder.volume.manager [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Starting volume driver QuobyteDriver (1.1.14) Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_down_time = 720 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] shell_completion = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] snapshot_name_template = snapshot-%s {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] split_loggers = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] state_path = /opt/stack/data/cinder {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85890]: DEBUG cinder.volume.drivers.remotefs [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85890) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] storage_availability_zone = nova {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] storage_protocol = iSCSI {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] syslog_log_facility = LOG_USER {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] target_helper = lioadm {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] target_ip_address = 192.168.122.135 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] target_port = 3260 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] target_protocol = iscsi {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] target_secondary_ip_addresses = [] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] trace_flags = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] transport_url = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] until_refresh = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] use_chap_auth = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] use_default_quota_class = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] use_journal = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] use_json = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] use_multipath_for_image_xfer = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] use_stderr = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] use_syslog = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] verify_glance_signatures = enabled {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_api_class = cinder.volume.api.API {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_backend_name = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_clear = zero {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_clear_ionice = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_clear_size = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_copy_bps_limit = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_dd_blocksize = 1M {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_name_template = volume-%s {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_service_inithost_offload = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volume_usage_audit_period = month {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] zoning_mode = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_concurrency.disable_process_locking = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.admin_password = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.admin_token = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.admin_user = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.auth_port = 35357 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.auth_protocol = https {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.auth_section = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.auth_type = password {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.auth_uri = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.auth_version = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.cache = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.certfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.identity_uri = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.include_service_catalog = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.insecure = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.interface = public {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.keyfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_password = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcache_username = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.region_name = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.service_type = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.backend = dogpile.cache.null {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.backend_argument = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.backend_expiration_time = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.config_prefix = cache.oslo {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.debug_cache_backend = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.enable_retry_client = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.enable_socket_keepalive = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.enabled = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.enforce_fips_mode = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.expiration_time = 600 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.hashclient_retry_attempts = 2 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.memcache_dead_retry = 300 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.memcache_pool_maxsize = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.memcache_sasl_enabled = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.password = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.proxies = [] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.redis_db = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.redis_server = localhost:6379 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.retry_attempts = 2 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.retry_delay = 0.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.socket_keepalive_count = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.socket_keepalive_idle = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.socket_keepalive_interval = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.socket_timeout = 1.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.tls_allowed_ciphers = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.tls_cafile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.tls_certfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.tls_enabled = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.tls_keyfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cache.username = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.asyncio_connection = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.asyncio_slave_connection = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.backend = sqlalchemy {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.connection = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.connection_debug = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.connection_parameters = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.connection_recycle_time = 3600 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.connection_trace = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.db_inc_retry_interval = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.db_max_retries = 20 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.db_max_retry_interval = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.db_retry_interval = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.max_overflow = 50 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.max_pool_size = 5 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.max_retries = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.mysql_wsrep_sync_wait = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.pool_timeout = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.retry_interval = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.slave_connection = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.sqlite_synchronous = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.synchronous_reader = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] database.use_db_reconnect = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.connection_string = messaging:// {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85890]: DEBUG cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85890) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.enabled = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.es_doc_type = notification {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.es_scroll_size = 10000 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.es_scroll_time = 2m {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.filter_error_trace = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85890]: WARNING cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.hmac_keys = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85890]: WARNING cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.sentinel_service_name = mymaster {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.socket_timeout = 0.1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.trace_requests = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler.trace_sqlalchemy = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler_jaeger.process_tags = {} {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler_jaeger.service_name_prefix = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] profiler_otlp.service_name_prefix = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Running cmd (subprocess): mount.quobyte {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.enforce_new_defaults = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: WARNING oslo_config.cfg [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.enforce_scope = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.policy_default_rule = default {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.policy_file = policy.yaml {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] coordination.backend_url = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] privsep_osbrick.group = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] privsep_osbrick.helper_command = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] privsep_osbrick.user = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cinder_sys_admin.group = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cinder_sys_admin.helper_command = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] cinder_sys_admin.user = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_user.auth_section = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_user.auth_type = password {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_user.cafile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_user.certfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_user.collect_timing = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_user.insecure = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_user.keyfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_user.send_service_user_token = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_user.split_loggers = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] service_user.timeout = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance.auth_section = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance.auth_type = password {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance.certfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance.collect_timing = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance.insecure = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance.keyfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance.region_name = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance.split_loggers = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] glance.timeout = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.backend_availability_zone = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.chap_password = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.chap_username = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.disk_geometry = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.driver_client_cert = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.driver_client_cert_key = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.driver_data_namespace = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.driver_use_ssl = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.extra_capabilities = {} {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.filter_function = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.goodness_function = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.iscsi_target_flags = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.iscsi_write_cache = on {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.iser_helper = tgtadm {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.iser_port = 3260 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nas_host = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nas_login = admin {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nas_mount_options = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nas_password = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nas_private_key = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nas_share_path = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.num_shell_tries = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.quobyte_volume_url = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.replication_device = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.report_discard_supported = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack quobyte-client[85939]: Reading configuration file: /etc/quobyte/client.cfg Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.reserved_percentage = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.target_helper = tgtadm {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack quobyte-client[85939]: Invalid parameters found, error: missing mount point. Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.target_port = 3260 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.target_protocol = iscsi {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.trace_flags = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack quobyte-client[85939]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.unique_fqdn_network = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.use_chap_auth = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.volume_backend_name = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.volume_clear = zero {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.volume_clear_ionice = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.volume_clear_size = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack quobyte-client[85939]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_reports.file_event_handler = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_reports.log_dir = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.backend_availability_zone = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.backend_host = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.chap_password = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.chap_username = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.chiscsi_conf = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.disk_geometry = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.driver_client_cert = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.driver_data_namespace = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.driver_use_ssl = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.extra_capabilities = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.filter_function = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.goodness_function = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.iser_helper = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.iser_ip_address = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.iser_port = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.iser_target_prefix = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nas_host = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nas_login = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nas_mount_options = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nas_password = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nas_private_key = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nas_share_path = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nas_ssh_port = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.num_shell_tries = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 -c /etc/quobyte/client-cinder.cfg Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.nvmet_port_id = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.replication_device = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.report_discard_supported = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.reserved_percentage = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.scst_target_driver = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.storage_protocol = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.target_helper = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.target_ip_address = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.target_port = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.target_prefix = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.target_protocol = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.trace_flags = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.use_chap_auth = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.volume_clear = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.volume_clear_size = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] QuobyteHD.volumes_dir = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.ssl = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_notifications.driver = [] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] CMD "mount.quobyte" returned: 1 in 0.109s {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_notifications.retry = -1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] key_manager.fixed_key = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:40:11 devstack cinder-volume[85890]: DEBUG cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=85890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.barbican_api_version = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.barbican_endpoint = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85890]: INFO cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 ... Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.barbican_endpoint_type = public {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.barbican_region_name = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 -c /etc/quobyte/client-cinder.cfg {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.cafile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.certfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.collect_timing = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.insecure = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.keyfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.number_of_retries = 60 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.retry_delay = 1 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.send_service_user_token = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.split_loggers = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.timeout = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.verify_ssl = True {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican.verify_ssl_path = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican_service_user.auth_section = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican_service_user.auth_type = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican_service_user.cafile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican_service_user.certfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican_service_user.collect_timing = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican_service_user.insecure = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican_service_user.keyfile = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican_service_user.split_loggers = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] barbican_service_user.timeout = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.approle_role_id = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.approle_secret_id = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.kv_mountpoint = secret {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.kv_path = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.kv_version = 2 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.namespace = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.root_token_id = **** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.ssl_ca_crt_file = None {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.timeout = 60.0 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.use_ssl = False {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:11 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] ******************************************************************************** {{(pid=85724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 03 14:40:12 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Jun 03 14:40:12 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.791s {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:40:12 devstack cinder-volume[85890]: INFO cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 succeeded Jun 03 14:40:12 devstack cinder-volume[85890]: DEBUG cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=85890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:40:12 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.803s {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:40:12 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:40:12 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:40:12 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:40:13 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.600s {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:40:13 devstack cinder-volume[85890]: INFO cinder.volume.driver [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Driver hasn't implemented _init_vendor_properties() Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG cinder.volume.driver [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85890) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_db.sqlalchemy.engines [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85890) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG dbcounter [-] [85890] Writer thread running {{(pid=85890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG cinder.db.sqlalchemy.api [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Building query based on filter {{(pid=85890) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG cinder.image.image_utils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85890) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 03 14:40:13 devstack cinder-volume[85890]: INFO cinder.keymgr.migration [None req-64cd1e20-7b7b-4af8-aadc-bf7c64001182 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=85890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=85890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:40:13 devstack sudo[86016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:40:13 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:40:13 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.582s {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG cinder.manager [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Notifying Schedulers of capabilities ... {{(pid=85890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:40:13 devstack cinder-volume[85890]: INFO cinder.volume.manager [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Driver initialization completed successfully. Jun 03 14:40:13 devstack cinder-volume[85890]: INFO cinder.manager [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Initiating service 3 cleanup Jun 03 14:40:13 devstack cinder-volume[85890]: INFO cinder.manager [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Service 3 cleanup completed. Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG cinder.service [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Creating RPC server for service cinder-volume {{(pid=85890) start /opt/stack/cinder/cinder/service.py:231}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG cinder.service [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85890) start /opt/stack/cinder/cinder/service.py:237}} Jun 03 14:40:13 devstack cinder-volume[85890]: INFO cinder.volume.manager [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=85890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG cinder.volume.drivers.quobyte [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=85890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:40:13 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:40:13 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:40:13 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:40:14 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Jun 03 14:40:14 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.618s {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:40:14 devstack cinder-volume[85890]: INFO cinder.volume.manager [None req-329362d7-8668-430a-81cb-af4bd778f8db None None] Driver post RPC initialization completed successfully. Jun 03 14:40:18 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-4306fdfd-64be-4c8f-a4bb-707b1aca208c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:40:18 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-4306fdfd-64be-4c8f-a4bb-707b1aca208c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:40:18 devstack cinder-volume[85890]: DEBUG cinder.volume.drivers.quobyte [None req-4306fdfd-64be-4c8f-a4bb-707b1aca208c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=85890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:40:18 devstack cinder-volume[85890]: DEBUG cinder.volume.drivers.quobyte [None req-4306fdfd-64be-4c8f-a4bb-707b1aca208c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=85890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:40:18 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-4306fdfd-64be-4c8f-a4bb-707b1aca208c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:40:18 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-4306fdfd-64be-4c8f-a4bb-707b1aca208c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:40:18 devstack sudo[86188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:40:18 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:40:19 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root Jun 03 14:40:19 devstack cinder-volume[85890]: DEBUG oslo_concurrency.processutils [None req-4306fdfd-64be-4c8f-a4bb-707b1aca208c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.589s {{(pid=85890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:40:19 devstack cinder-volume[85890]: DEBUG cinder.manager [None req-4306fdfd-64be-4c8f-a4bb-707b1aca208c None None] Notifying Schedulers of capabilities ... {{(pid=85890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:40:21 devstack cinder-volume[85724]: DEBUG dbcounter [-] [85724] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:40:22 devstack cinder-volume[85724]: INFO oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Caught SIGTERM, stopping children Jun 03 14:40:22 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Acquiring lock "singleton_lock" {{(pid=85724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 14:40:22 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Acquired lock "singleton_lock" {{(pid=85724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 14:40:22 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Releasing lock "singleton_lock" {{(pid=85724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 14:40:22 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Stop services. {{(pid=85724) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 03 14:40:22 devstack cinder-volume[85724]: DEBUG oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Killing children. {{(pid=85724) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 03 14:40:22 devstack cinder-volume[85724]: INFO oslo_service.backend._eventlet.service [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Waiting on 1 children to exit Jun 03 14:40:24 devstack cinder-volume[85890]: DEBUG dbcounter [-] [85890] Writing DB stats cinder:SELECT=3 {{(pid=85890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:40:24 devstack cinder-volume[85890]: DEBUG dbcounter [-] [85890] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:40:27 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Acquiring lock "singleton_lock" {{(pid=85890) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 14:40:27 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Acquired lock "singleton_lock" {{(pid=85890) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 14:40:27 devstack cinder-volume[85890]: DEBUG oslo_concurrency.lockutils [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Releasing lock "singleton_lock" {{(pid=85890) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 14:40:27 devstack cinder-volume[85890]: WARNING amqp [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 03 14:40:27 devstack cinder-volume[85890]: WARNING amqp [None req-616704f4-081e-44bc-a639-9c720775d9f6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 03 14:40:30 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 14:40:30 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 14:40:30 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 14:40:31 devstack cinder-volume[86412]: INFO dbcounter [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Registered counter for database cinder Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_db.sqlalchemy.engines [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG dbcounter [-] [86412] Writer thread running {{(pid=86412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 14:40:31 devstack cinder-volume[86412]: INFO cinder.rpc [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 03 14:40:31 devstack cinder-volume[86412]: INFO cinder.rpc [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_db.sqlalchemy.engines [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:40:31 devstack cinder-volume[86412]: INFO cinder.volume.manager [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Determined volume DB was empty at startup. Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG cinder.volume.manager [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86412) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 03 14:40:31 devstack cinder-volume[86412]: WARNING stevedore.named [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 03 14:40:31 devstack cinder-volume[86412]: WARNING castellan.key_manager [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 14:40:31 devstack cinder-volume[86412]: WARNING cinder.keymgr.conf_key_mgr [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 14:40:31 devstack cinder-volume[86412]: INFO cinder.volume.manager [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_db.sqlalchemy.engines [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:40:31 devstack cinder-volume[86412]: INFO oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Starting 1 workers Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Started child 86614 {{(pid=86412) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Full set of CONF: {{(pid=86412) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] ******************************************************************************** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Configuration options gathered from: {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] ================================================================================ {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] allow_availability_zone_fallback = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] allow_compression_on_image_upload = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] allowed_direct_url_schemes = [] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] api_rate_limit = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] auth_strategy = keystone {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_availability_zone = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_host = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_name = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_stats_polling_interval = 60 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86614]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backup_api_class = cinder.backup.api.API {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backup_name_template = backup-%s {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backup_use_same_host = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backup_use_temp_snapshot = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] chap_password = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] chap_username = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cinder_internal_tenant_project_id = 2a1f962eaa804fdaa827feda095c2738 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cinder_internal_tenant_user_id = a3a6798fca1e4dc9af979f2698ba64c2 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cluster = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] compression_format = gzip {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] compute_api_class = cinder.compute.nova.API {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] config_dir = [] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] config_source = [] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] control_exchange = openstack {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] debug = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] default_availability_zone = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] default_group_type = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] default_volume_type = QuobyteHD {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] disk_geometry = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] driver_client_cert = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] driver_client_cert_key = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] driver_data_namespace = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] driver_ssl_cert_path = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] driver_ssl_cert_verify = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] driver_use_ssl = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] enable_new_services = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] enable_unsupported_driver = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] enabled_backends = ['QuobyteHD'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] enforce_multipath_for_image_xfer = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] filter_function = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance_api_insecure = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance_api_ssl_compression = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance_ca_certificates_file = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance_catalog_info = image:glance:publicURL {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance_certfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance_keyfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance_num_retries = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance_request_timeout = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] goodness_function = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] graceful_shutdown_timeout = 5 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] group_api_class = cinder.group.api.API {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] host = devstack {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] image_compress_on_upload = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] image_conversion_address_space_limit = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] image_conversion_cpu_limit = 60 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] image_conversion_disable = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] image_upload_use_cinder_backend = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] image_upload_use_internal_tenant = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] image_volume_cache_enabled = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] image_volume_cache_max_count = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] image_volume_cache_max_size_gb = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] init_host_max_objects_retrieval = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] instance_format = [instance: %(uuid)s] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] iscsi_target_flags = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] iscsi_write_cache = on {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] iser_helper = tgtadm {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] iser_ip_address = 192.168.122.135 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] iser_port = 3260 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] log_color = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] log_config_append = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] log_dir = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86614) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] log_file = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] log_options = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] log_rotate_interval = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] log_rotate_interval_type = days {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] log_rotation_type = none {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] max_age = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] max_logfile_count = 30 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] max_logfile_size_mb = 200 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] max_over_subscription_ratio = 20.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] message_reap_interval = 86400 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] message_ttl = 2592000 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] migration_create_volume_timeout_secs = 300 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] monkey_patch = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] monkey_patch_modules = [] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] my_ip = 192.168.122.135 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] no_snapshot_gb_quota = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] num_iser_scan_tries = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] num_shell_tries = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] num_volume_device_scan_tries = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] nvmeof_conn_info_version = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] nvmet_ns_id = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] nvmet_port_id = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] osapi_max_limit = 1000 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] osapi_volume_ext_list = [] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] osapi_volume_listen_port = 8776 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] osapi_volume_use_ssl = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] osapi_volume_workers = 2 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] per_volume_size_limit = -1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] periodic_fuzzy_delay = 60 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] periodic_interval = 60 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] public_endpoint = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] publish_errors = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] quota_backup_gigabytes = 1000 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] quota_backups = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] quota_gigabytes = 1000 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] quota_groups = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] quota_snapshots = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] quota_volumes = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] rate_limit_burst = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] rate_limit_except_level = CRITICAL {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] rate_limit_interval = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] reinit_driver_count = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] replication_device = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] report_discard_supported = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] report_interval = 120 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] reservation_clean_interval = 86400 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] reservation_expire = 86400 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] reserved_image_namespaces = [] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] reserved_percentage = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] rpc_response_timeout = 120 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] run_external_periodic_tasks = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] scst_target_driver = iscsi {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] scst_target_iqn_name = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_down_time = 720 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] shell_completion = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] snapshot_name_template = snapshot-%s {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] split_loggers = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] state_path = /opt/stack/data/cinder {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] storage_availability_zone = nova {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] storage_protocol = iSCSI {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] syslog_log_facility = LOG_USER {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] target_helper = lioadm {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] target_ip_address = 192.168.122.135 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] target_port = 3260 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] target_protocol = iscsi {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] target_secondary_ip_addresses = [] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] trace_flags = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] transport_url = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] until_refresh = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] use_chap_auth = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] use_default_quota_class = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] use_journal = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] use_json = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] use_multipath_for_image_xfer = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] use_stderr = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] use_syslog = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] verify_glance_signatures = enabled {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_api_class = cinder.volume.api.API {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_backend_name = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_clear = zero {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_clear_ionice = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_clear_size = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_copy_bps_limit = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_dd_blocksize = 1M {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_name_template = volume-%s {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_service_inithost_offload = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volume_usage_audit_period = month {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] zoning_mode = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_concurrency.disable_process_locking = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.admin_password = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.admin_token = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.admin_user = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.auth_admin_prefix = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.auth_port = 35357 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.auth_protocol = https {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.auth_section = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.auth_type = password {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.auth_uri = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.auth_version = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.cache = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.certfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.identity_uri = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.include_service_catalog = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.insecure = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.interface = public {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.keyfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_password = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86614) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 03 14:40:31 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.quobyte [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 03 14:40:31 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.quobyte [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Running cmd (subprocess): mount.quobyte {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcache_username = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.region_name = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.service_token_roles_required = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.service_type = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.backend = dogpile.cache.null {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.backend_argument = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.backend_expiration_time = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.config_prefix = cache.oslo {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.debug_cache_backend = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.enable_retry_client = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.enable_socket_keepalive = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.enabled = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.enforce_fips_mode = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.expiration_time = 600 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.hashclient_retry_attempts = 2 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.memcache_dead_retry = 300 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.memcache_pool_maxsize = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.memcache_sasl_enabled = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.password = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.proxies = [] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.redis_db = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.redis_server = localhost:6379 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.retry_attempts = 2 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.retry_delay = 0.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.socket_keepalive_count = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.socket_keepalive_idle = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.socket_keepalive_interval = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.socket_timeout = 1.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.tls_allowed_ciphers = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.tls_cafile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.tls_certfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.tls_enabled = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.tls_keyfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cache.username = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.asyncio_connection = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.asyncio_slave_connection = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.backend = sqlalchemy {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.connection = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.connection_debug = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.connection_parameters = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.connection_recycle_time = 3600 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.connection_trace = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.db_inc_retry_interval = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.db_max_retries = 20 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.db_max_retry_interval = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.db_retry_interval = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.max_overflow = 50 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.max_pool_size = 5 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.max_retries = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.mysql_wsrep_sync_wait = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.pool_timeout = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.retry_interval = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.slave_connection = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.sqlite_synchronous = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.synchronous_reader = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] database.use_db_reconnect = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.connection_string = messaging:// {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.enabled = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.es_doc_type = notification {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.es_scroll_size = 10000 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.es_scroll_time = 2m {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.filter_error_trace = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.hmac_keys = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.sentinel_service_name = mymaster {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.socket_timeout = 0.1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.trace_requests = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler.trace_sqlalchemy = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler_jaeger.process_tags = {} {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler_jaeger.service_name_prefix = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] profiler_otlp.service_name_prefix = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.enforce_new_defaults = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: WARNING oslo_config.cfg [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.enforce_scope = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.policy_default_rule = default {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.policy_file = policy.yaml {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] coordination.backend_url = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] privsep_osbrick.group = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] privsep_osbrick.helper_command = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] privsep_osbrick.user = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cinder_sys_admin.group = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cinder_sys_admin.helper_command = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] cinder_sys_admin.user = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_user.auth_section = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_user.auth_type = password {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_user.cafile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_user.certfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_user.collect_timing = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_user.insecure = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_user.keyfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_user.send_service_user_token = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_user.split_loggers = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] service_user.timeout = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance.auth_section = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance.auth_type = password {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance.certfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance.collect_timing = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance.insecure = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance.keyfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance.region_name = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance.split_loggers = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] glance.timeout = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.backend_availability_zone = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.chap_password = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.chap_username = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.disk_geometry = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.driver_client_cert = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.driver_client_cert_key = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.driver_data_namespace = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.driver_use_ssl = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.extra_capabilities = {} {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.filter_function = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.goodness_function = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.iscsi_target_flags = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.iscsi_write_cache = on {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.iser_helper = tgtadm {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.iser_port = 3260 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nas_host = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nas_login = admin {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nas_mount_options = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nas_password = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nas_private_key = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nas_share_path = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.num_shell_tries = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack quobyte-client[86615]: Reading configuration file: /etc/quobyte/client.cfg Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack quobyte-client[86615]: Invalid parameters found, error: missing mount point. Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.quobyte_volume_url = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.replication_device = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.report_discard_supported = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.reserved_percentage = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack quobyte-client[86615]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.target_helper = tgtadm {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack quobyte-client[86615]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 03 14:40:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.target_port = 3260 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.target_protocol = iscsi {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.trace_flags = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.unique_fqdn_network = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.use_chap_auth = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.volume_backend_name = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.volume_clear = zero {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.volume_clear_ionice = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.volume_clear_size = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_reports.file_event_handler = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_reports.log_dir = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.backend_availability_zone = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.backend_host = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.chap_password = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.chap_username = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.chiscsi_conf = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.disk_geometry = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.driver_client_cert = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.driver_data_namespace = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.driver_use_ssl = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.extra_capabilities = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.filter_function = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.goodness_function = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.iser_helper = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.iser_ip_address = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.iser_port = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.iser_target_prefix = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nas_host = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nas_login = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nas_mount_options = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nas_password = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nas_private_key = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nas_share_path = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nas_ssh_port = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.num_shell_tries = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.nvmet_port_id = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.replication_device = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.report_discard_supported = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.reserved_percentage = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.scst_target_driver = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.storage_protocol = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.target_helper = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.target_ip_address = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.target_port = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.target_prefix = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.target_protocol = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.trace_flags = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.use_chap_auth = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.volume_clear = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.volume_clear_size = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] QuobyteHD.volumes_dir = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.ssl = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_notifications.driver = [] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_notifications.retry = -1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] key_manager.fixed_key = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.barbican_api_version = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.barbican_endpoint = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.barbican_endpoint_type = public {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.barbican_region_name = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.cafile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.certfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.collect_timing = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.insecure = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.keyfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.number_of_retries = 60 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.retry_delay = 1 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.send_service_user_token = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.split_loggers = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.timeout = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.verify_ssl = True {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican.verify_ssl_path = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican_service_user.auth_section = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican_service_user.auth_type = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican_service_user.cafile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican_service_user.certfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican_service_user.collect_timing = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican_service_user.insecure = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican_service_user.keyfile = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican_service_user.split_loggers = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] barbican_service_user.timeout = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.approle_role_id = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.approle_secret_id = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.kv_mountpoint = secret {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.kv_path = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.kv_version = 2 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.namespace = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.root_token_id = **** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.ssl_ca_crt_file = None {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.timeout = 60.0 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.use_ssl = False {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 14:40:31 devstack cinder-volume[86412]: DEBUG oslo_service.backend._eventlet.service [None req-18ac31a4-8dc8-439a-8727-17ee03fc4d01 None None] ******************************************************************************** {{(pid=86412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 03 14:40:32 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.557s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:40:32 devstack cinder-volume[86614]: INFO cinder.volume.driver [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Driver hasn't implemented _init_vendor_properties() Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG cinder.volume.driver [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86614) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG oslo_db.sqlalchemy.engines [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writer thread running {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG cinder.db.sqlalchemy.api [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Building query based on filter {{(pid=86614) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86614) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:40:32 devstack cinder-volume[86614]: INFO cinder.keymgr.migration [None req-362753ae-2060-4e4e-85a1-cc1ee2917a55 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 03 14:40:32 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:40:32 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:40:32 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.562s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:40:32 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Driver initialization completed successfully. Jun 03 14:40:32 devstack cinder-volume[86614]: INFO cinder.manager [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Initiating service 3 cleanup Jun 03 14:40:32 devstack cinder-volume[86614]: INFO cinder.manager [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Service 3 cleanup completed. Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG cinder.service [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Creating RPC server for service cinder-volume {{(pid=86614) start /opt/stack/cinder/cinder/service.py:231}} Jun 03 14:40:32 devstack cinder-volume[86614]: DEBUG cinder.service [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86614) start /opt/stack/cinder/cinder/service.py:237}} Jun 03 14:40:33 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 03 14:40:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:40:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:40:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:40:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:40:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:40:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:40:33 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:40:33 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:40:33 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Jun 03 14:40:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.570s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:40:33 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e418c12b-5e61-4afd-ab16-c2bbce873c65 None None] Driver post RPC initialization completed successfully. Jun 03 14:40:41 devstack cinder-volume[86412]: DEBUG dbcounter [-] [86412] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:40:42 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:40:43 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=2 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:40:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:40:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 6 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:40:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:41:30 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Flow 'volume_create_manager' (2b621563-9f57-4bbf-8480-a75147e8b4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f31112-fc93-4e33-a687-e96e1b4b8f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f31112-fc93-4e33-a687-e96e1b4b8f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-256218336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6539fbe3-4fef-4ae2-8db4-b3d6de00df58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4d9714045346d2b09b85d604c6daf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:41:31Z,use_quota=True,user_id='fe82415016784b3b89b6946fad349ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (766ab204-f2b1-4aa6-9500-743e24512372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (766ab204-f2b1-4aa6-9500-743e24512372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cdd074-3eb7-476c-a575-059c09f8055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cdd074-3eb7-476c-a575-059c09f8055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6539fbe3-4fef-4ae2-8db4-b3d6de00df58', 'volume_name': 'volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c1e35c-96bb-49f9-8553-6a078abe4d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c1e35c-96bb-49f9-8553-6a078abe4d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49aefca-d9b9-4ea6-bb9a-745b1f57d0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:31 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Volume 6539fbe3-4fef-4ae2-8db4-b3d6de00df58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58', 'volume_size': 1} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-256218336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6539fbe3-4fef-4ae2-8db4-b3d6de00df58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4d9714045346d2b09b85d604c6daf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:41:31Z,use_quota=True,user_id='fe82415016784b3b89b6946fad349ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Creating volume 6539fbe3-4fef-4ae2-8db4-b3d6de00df58 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:41:31 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:41:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:41:31 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 1073741824 Jun 03 14:41:31 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:41:33 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Jun 03 14:41:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 1073741824" returned: 0 in 2.083s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:41:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:41:33 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 Jun 03 14:41:33 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:41:34 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Jun 03 14:41:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58" returned: 0 in 1.128s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:41:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] <== create_volume: return (3312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:41:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.320s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:41:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49aefca-d9b9-4ea6-bb9a-745b1f57d0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775da8b5-2e40-416e-9b86-579bdb2265a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:34 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Volume volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 (6539fbe3-4fef-4ae2-8db4-b3d6de00df58): created successfully Jun 03 14:41:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775da8b5-2e40-416e-9b86-579bdb2265a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Flow 'volume_create_manager' (2b621563-9f57-4bbf-8480-a75147e8b4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:41:34 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1a946e72-5b84-4bfc-aed1-5245b3bff3a0 tempest-TaggedAttachmentsTest-636751611 None] Created volume successfully. Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Flow 'volume_create_manager' (b21c8857-59d7-40d8-937d-01f42a9d16f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42c691d-c6b1-4736-a0b1-d252f7f89791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42c691d-c6b1-4736-a0b1-d252f7f89791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1138765523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a54906-c16c-4dd1-9d45-9abf619829cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fc1e65ad414743b0464b6e0c0d1a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:41:38Z,use_quota=True,user_id='017f8c96f4784f33b1c15e6443788fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45be9c7f-c7a0-43e4-a4bc-18069652f024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45be9c7f-c7a0-43e4-a4bc-18069652f024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1cabda-82ab-4dc9-ad2c-d7b3746f542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1cabda-82ab-4dc9-ad2c-d7b3746f542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a54906-c16c-4dd1-9d45-9abf619829cc', 'volume_name': 'volume-b5a54906-c16c-4dd1-9d45-9abf619829cc', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd60d09-dffc-41b1-9492-6be77ed91d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd60d09-dffc-41b1-9492-6be77ed91d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed86acbe-74ce-48a4-b66d-07cbd8027de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:37 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Volume b5a54906-c16c-4dd1-9d45-9abf619829cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a54906-c16c-4dd1-9d45-9abf619829cc', 'volume_size': 1} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1138765523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a54906-c16c-4dd1-9d45-9abf619829cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fc1e65ad414743b0464b6e0c0d1a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:41:38Z,use_quota=True,user_id='017f8c96f4784f33b1c15e6443788fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Creating volume b5a54906-c16c-4dd1-9d45-9abf619829cc {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:41:37 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:41:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:41:37 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc 1073741824 Jun 03 14:41:37 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:41:40 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Jun 03 14:41:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc 1073741824" returned: 0 in 2.339s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:41:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:41:40 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc Jun 03 14:41:40 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:41:42 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Jun 03 14:41:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc" returned: 0 in 1.864s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:41:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] <== create_volume: return (4313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:41:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.323s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:41:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed86acbe-74ce-48a4-b66d-07cbd8027de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a54906-c16c-4dd1-9d45-9abf619829cc', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebc542f-c510-4188-a96d-7c6f4b065ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:41:42 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Volume volume-b5a54906-c16c-4dd1-9d45-9abf619829cc (b5a54906-c16c-4dd1-9d45-9abf619829cc): created successfully Jun 03 14:41:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebc542f-c510-4188-a96d-7c6f4b065ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:41:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Flow 'volume_create_manager' (b21c8857-59d7-40d8-937d-01f42a9d16f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:41:42 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-6855107b-6284-453c-9b8a-4f075224b428 tempest-DeleteServersTestJSON-678883826 None] Created volume successfully. Jun 03 14:41:51 devstack cinder-volume[86614]: WARNING py.warnings [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 03 14:41:51 devstack cinder-volume[86614]: .first() Jun 03 14:41:51 devstack cinder-volume[86614]: Jun 03 14:41:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:41:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:41:51 devstack cinder-volume[86614]: INFO oslo.privsep.daemon [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1jb74u0q/privsep.sock'] Jun 03 14:41:51 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1jb74u0q/privsep.sock Jun 03 14:41:51 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:41:53 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Jun 03 14:41:53 devstack cinder-volume[86614]: INFO oslo.privsep.daemon [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] Spawned new privsep daemon via rootwrap Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] Accepted privsep connection to /tmp/tmp1jb74u0q/privsep.sock {{(pid=86614) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 03 14:41:53 devstack cinder-volume[86614]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 03 14:41:53 devstack cinder-volume[86614]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 03 14:41:53 devstack cinder-volume[86614]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 03 14:41:53 devstack cinder-volume[86614]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87576 Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[525701a9-994a-4c3d-a4a9-9a0b46c45a39]: (2,) {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[617002ec-9339-4a44-a893-85405ab36211]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:41:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:41:53 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:41:53 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:41:53 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc Jun 03 14:41:53 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:41:54 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Jun 03 14:41:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.923s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:41:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:41:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:41:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 8 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:41:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:41:54 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Jun 03 14:41:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc" returned: 0 in 1.003s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:41:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.145s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:41:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-b5a54906-c16c-4dd1-9d45-9abf619829cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44a48254-a85f-4d0d-b355-8aaa7356c412', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:41:54 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-ec38ac6b-78ef-47f4-b90a-90f66b77cefa req-b758be2f-f5f7-4352-ac69-574d30c37c03 tempest-DeleteServersTestJSON-678883826 None] attachment_update completed successfully. Jun 03 14:42:04 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:42:04 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:42:06 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-336364de-e8b5-4fe5-afa2-5f1a21665dba req-f59884ab-c509-42fc-8afd-6573b257ebe4 tempest-DeleteServersTestJSON-678883826 None] Terminate volume connection completed successfully. Jun 03 14:42:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-336364de-e8b5-4fe5-afa2-5f1a21665dba req-f59884ab-c509-42fc-8afd-6573b257ebe4 tempest-DeleteServersTestJSON-678883826 None] Deleting attachment 44a48254-a85f-4d0d-b355-8aaa7356c412. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:42:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Acquiring lock "cinder-b5a54906-c16c-4dd1-9d45-9abf619829cc-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:42:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Lock "cinder-b5a54906-c16c-4dd1-9d45-9abf619829cc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:42:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Acquiring lock "cinder-quobyte-b5a54906-c16c-4dd1-9d45-9abf619829cc" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:42:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Lock "cinder-quobyte-b5a54906-c16c-4dd1-9d45-9abf619829cc" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:42:12 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daa0897-0048-48b1-b019-1ff6a44b650d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:12 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc Jun 03 14:42:12 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:13 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc" returned: 0 in 0.830s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:13 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc Jun 03 14:42:13 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:14 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b5a54906-c16c-4dd1-9d45-9abf619829cc" returned: 0 in 0.763s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Lock "cinder-quobyte-b5a54906-c16c-4dd1-9d45-9abf619829cc" released by "delete_volume" :: held 1.639s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:42:14 devstack cinder-volume[86614]: WARNING cinder.quota [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:42:14 devstack cinder-volume[86614]: WARNING cinder.quota [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:42:14 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Created reservations ['a1cc51a6-6366-49a9-a89b-443a3dabfceb', 'f9bc1f44-8497-49d0-97de-5e7b0e0e9917', 'e718c215-cd5d-453f-a000-2f46899afcc8', '1c602c97-980a-4081-baa5-1df22035ceda'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:42:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:42:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:42:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:14 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:42:14 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:15 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.958s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:15 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:42:15 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Deleted volume successfully. Jun 03 14:42:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-64435364-c04b-4e3e-8cf2-b6c7be514fc2 tempest-DeleteServersTestJSON-678883826 None] Lock "cinder-b5a54906-c16c-4dd1-9d45-9abf619829cc-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Flow 'volume_create_manager' (08546543-6e62-4e93-ad83-ad432e3ff86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9178545-c7f2-45ed-ba12-1d3c99c1f7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9178545-c7f2-45ed-ba12-1d3c99c1f7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1134637792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b4a55b-c4fc-4423-9a02-44d3be814b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0976b8bc8a5740a4866c04d4257ee4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:42:18Z,use_quota=True,user_id='c5b38df90ef34028a2753b047cd4a3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9ca180-dddf-4e62-8ba2-06b7f004df63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9ca180-dddf-4e62-8ba2-06b7f004df63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a882ba2-b5a6-412b-9c1b-c7a8bcac108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a882ba2-b5a6-412b-9c1b-c7a8bcac108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b4a55b-c4fc-4423-9a02-44d3be814b78', 'volume_name': 'volume-41b4a55b-c4fc-4423-9a02-44d3be814b78', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50ab6d2-079b-4edc-bcea-e75a13b11af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50ab6d2-079b-4edc-bcea-e75a13b11af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd53623-6d36-4021-a451-740ba2095b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:18 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Volume 41b4a55b-c4fc-4423-9a02-44d3be814b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b4a55b-c4fc-4423-9a02-44d3be814b78', 'volume_size': 1} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1134637792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b4a55b-c4fc-4423-9a02-44d3be814b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0976b8bc8a5740a4866c04d4257ee4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:42:18Z,use_quota=True,user_id='c5b38df90ef34028a2753b047cd4a3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Creating volume 41b4a55b-c4fc-4423-9a02-44d3be814b78 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:42:18 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:42:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:18 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78 1073741824 Jun 03 14:42:18 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:19 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78 1073741824" returned: 0 in 1.197s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:19 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78 Jun 03 14:42:19 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:20 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78" returned: 0 in 0.712s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:42:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd53623-6d36-4021-a451-740ba2095b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b4a55b-c4fc-4423-9a02-44d3be814b78', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0440d22-2e3a-446d-a014-dd26d3fa2622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:20 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Volume volume-41b4a55b-c4fc-4423-9a02-44d3be814b78 (41b4a55b-c4fc-4423-9a02-44d3be814b78): created successfully Jun 03 14:42:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0440d22-2e3a-446d-a014-dd26d3fa2622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Flow 'volume_create_manager' (08546543-6e62-4e93-ad83-ad432e3ff86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:42:20 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-3506ad57-ba87-4e4f-82f8-2dede6ce6d0c tempest-ServersNegativeTestJSON-591971282 None] Created volume successfully. Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Flow 'volume_create_manager' (3d622b08-6072-44c7-ad57-dbd37ea2cc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165c44c8-b72e-4689-b03c-6594fd333a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165c44c8-b72e-4689-b03c-6594fd333a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-604561351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48a0e88-cdea-48a7-839d-f83432036771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0976b8bc8a5740a4866c04d4257ee4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:42:23Z,use_quota=True,user_id='c5b38df90ef34028a2753b047cd4a3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa23bd7e-2f85-4342-9733-4007f15ca881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa23bd7e-2f85-4342-9733-4007f15ca881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1de0e9-8dc0-4029-b8ea-0fbfacc9113f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1de0e9-8dc0-4029-b8ea-0fbfacc9113f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48a0e88-cdea-48a7-839d-f83432036771', 'volume_name': 'volume-b48a0e88-cdea-48a7-839d-f83432036771', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36db7a19-5ee7-4a92-b4dd-f9fca0b87ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36db7a19-5ee7-4a92-b4dd-f9fca0b87ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2308edb7-cd69-40d4-abac-b346df7bc90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:23 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Volume b48a0e88-cdea-48a7-839d-f83432036771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48a0e88-cdea-48a7-839d-f83432036771', 'volume_size': 1} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-604561351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48a0e88-cdea-48a7-839d-f83432036771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0976b8bc8a5740a4866c04d4257ee4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:42:23Z,use_quota=True,user_id='c5b38df90ef34028a2753b047cd4a3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Creating volume b48a0e88-cdea-48a7-839d-f83432036771 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:42:23 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:42:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:23 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771 1073741824 Jun 03 14:42:23 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:24 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771 1073741824" returned: 0 in 1.091s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:24 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771 Jun 03 14:42:24 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:25 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771" returned: 0 in 0.794s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:42:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2308edb7-cd69-40d4-abac-b346df7bc90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48a0e88-cdea-48a7-839d-f83432036771', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e605d63a-965b-4b23-8095-4a073a7a2557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:25 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Volume volume-b48a0e88-cdea-48a7-839d-f83432036771 (b48a0e88-cdea-48a7-839d-f83432036771): created successfully Jun 03 14:42:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e605d63a-965b-4b23-8095-4a073a7a2557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Flow 'volume_create_manager' (3d622b08-6072-44c7-ad57-dbd37ea2cc32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:42:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1aa176fa-f66a-42f1-b58d-dd0b4d8b7a70 tempest-ServersNegativeTestJSON-591971282 None] Created volume successfully. Jun 03 14:42:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Acquiring lock "cinder-b48a0e88-cdea-48a7-839d-f83432036771-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:42:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Lock "cinder-b48a0e88-cdea-48a7-839d-f83432036771-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:42:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Acquiring lock "cinder-quobyte-b48a0e88-cdea-48a7-839d-f83432036771" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:42:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Lock "cinder-quobyte-b48a0e88-cdea-48a7-839d-f83432036771" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:42:27 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f649b05-a0b4-4025-9935-b71f30514748]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:27 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771 Jun 03 14:42:27 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:28 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771" returned: 0 in 0.977s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:28 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771 Jun 03 14:42:28 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:29 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b48a0e88-cdea-48a7-839d-f83432036771" returned: 0 in 0.776s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Lock "cinder-quobyte-b48a0e88-cdea-48a7-839d-f83432036771" released by "delete_volume" :: held 1.821s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Created reservations ['26fc8a1c-3923-401b-9354-0c6d233865c5', '56ca1413-7ed9-475a-9005-03c084f12717', '48412356-cbcf-4863-afa8-eb95e29f95bf', '9f10f14a-4e36-4efc-b420-46b38b2f2bfa'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:29 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:42:29 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Acquiring lock "cinder-41b4a55b-c4fc-4423-9a02-44d3be814b78-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Lock "cinder-41b4a55b-c4fc-4423-9a02-44d3be814b78-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Acquiring lock "cinder-quobyte-41b4a55b-c4fc-4423-9a02-44d3be814b78" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Lock "cinder-quobyte-41b4a55b-c4fc-4423-9a02-44d3be814b78" acquired by "delete_volume" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a354805-444f-48fb-95f7-9a805c89f8ce]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:29 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78 Jun 03 14:42:29 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:30 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.834s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:30 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:42:30 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Deleted volume successfully. Jun 03 14:42:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fac97376-6397-4dce-98a6-b859f701fccf tempest-ServersNegativeTestJSON-591971282 None] Lock "cinder-b48a0e88-cdea-48a7-839d-f83432036771-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:42:30 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78" returned: 0 in 0.889s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:30 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78 Jun 03 14:42:30 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:31 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-41b4a55b-c4fc-4423-9a02-44d3be814b78" returned: 0 in 0.700s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Lock "cinder-quobyte-41b4a55b-c4fc-4423-9a02-44d3be814b78" released by "delete_volume" :: held 1.648s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:42:31 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Created reservations ['1a9ce1d4-8211-4301-b5c0-f5657281934e', '28ea7966-c3c7-4acb-b2ab-99f2752645fe', 'd04915cc-1531-4d18-bcaf-db79cb484fa9', 'c0ed2369-a840-4f11-979d-4ff4549b1cfb'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:42:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:42:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:42:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:31 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:42:31 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e6029f4b-2137-4e7f-9176-02dfae29c5b3 tempest-GroupsV314Test-363651425 None] Group tempest-GroupsV314Test-Group-1031310487: creating Jun 03 14:42:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e6029f4b-2137-4e7f-9176-02dfae29c5b3 tempest-GroupsV314Test-363651425 None] Group tempest-GroupsV314Test-Group-1031310487: created successfully Jun 03 14:42:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e6029f4b-2137-4e7f-9176-02dfae29c5b3 tempest-GroupsV314Test-363651425 None] Create group completed successfully. Jun 03 14:42:32 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.744s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:32 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:42:32 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Deleted volume successfully. Jun 03 14:42:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df8a580a-570e-4f0b-a2bb-c35ee3f9cc8f tempest-ServersNegativeTestJSON-591971282 None] Lock "cinder-41b4a55b-c4fc-4423-9a02-44d3be814b78-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Flow 'volume_create_manager' (05c07668-aa68-4e54-bdb9-66d901ae0780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375d9111-9691-4edb-b2a7-da397cf4da19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375d9111-9691-4edb-b2a7-da397cf4da19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1470484861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a456375-af1d-42df-8527-d2f0053d6518,host='devstack@QuobyteHD#QuobyteHD',id=ba890ce5-7d29-4635-801b-117ffea1c56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf7848956004302833dc2430450e343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:42:33Z,use_quota=True,user_id='8b8a7e324aba4719bb858622b025d9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b7bd053-023a-4308-97bc-f520f1aa9fe7),volume_type_id=6b7bd053-023a-4308-97bc-f520f1aa9fe7)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004c4ca9-97b1-46a8-bdf0-f0e5c715b314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004c4ca9-97b1-46a8-bdf0-f0e5c715b314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad38c63f-ca17-4d56-8747-7158523718aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad38c63f-ca17-4d56-8747-7158523718aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba890ce5-7d29-4635-801b-117ffea1c56a', 'volume_name': 'volume-ba890ce5-7d29-4635-801b-117ffea1c56a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3275a735-5ad7-41f1-9530-1d5a8cb3fbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3275a735-5ad7-41f1-9530-1d5a8cb3fbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f1603d-cb3f-4e5e-89b4-62569ccb94d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:33 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Volume ba890ce5-7d29-4635-801b-117ffea1c56a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba890ce5-7d29-4635-801b-117ffea1c56a', 'volume_size': 1} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8a456375-af1d-42df-8527-d2f0053d6518,created_at=2026-06-03T12:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1470484861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a456375-af1d-42df-8527-d2f0053d6518,host='devstack@QuobyteHD#QuobyteHD',id=ba890ce5-7d29-4635-801b-117ffea1c56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf7848956004302833dc2430450e343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:42:33Z,use_quota=True,user_id='8b8a7e324aba4719bb858622b025d9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b7bd053-023a-4308-97bc-f520f1aa9fe7),volume_type_id=6b7bd053-023a-4308-97bc-f520f1aa9fe7)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Creating volume ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:42:33 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:42:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:33 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a 1073741824 Jun 03 14:42:33 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:34 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a 1073741824" returned: 0 in 1.058s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:34 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a Jun 03 14:42:34 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:35 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a" returned: 0 in 0.692s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:42:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f1603d-cb3f-4e5e-89b4-62569ccb94d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba890ce5-7d29-4635-801b-117ffea1c56a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6046402c-e4fa-419a-94b2-14c7e56a761c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:42:35 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Volume volume-ba890ce5-7d29-4635-801b-117ffea1c56a (ba890ce5-7d29-4635-801b-117ffea1c56a): created successfully Jun 03 14:42:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6046402c-e4fa-419a-94b2-14c7e56a761c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:42:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Flow 'volume_create_manager' (05c07668-aa68-4e54-bdb9-66d901ae0780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:42:35 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b650b0a0-f348-48d9-a55b-b73658b35c6a tempest-GroupsV314Test-363651425 None] Created volume successfully. Jun 03 14:42:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:36 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Cloning volume ba890ce5-7d29-4635-801b-117ffea1c56a to volume f37377cd-bf11-41db-aa10-4a2d0ad8b378 Jun 03 14:42:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Creating offline snapshot 3780d960-4d90-40f3-b538-328e9dfe6764 of volume ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:42:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[942282a4-fec8-4f78-a5ff-a45a3f4753cf]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:36 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a Jun 03 14:42:36 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:37 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a" returned: 0 in 0.981s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:37 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 1G Jun 03 14:42:37 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:38 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 1G" returned: 0 in 0.935s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba890ce5-7d29-4635-801b-117ffea1c56a -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:38 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba890ce5-7d29-4635-801b-117ffea1c56a -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 Jun 03 14:42:38 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:39 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba890ce5-7d29-4635-801b-117ffea1c56a -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764" returned: 0 in 0.941s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:39 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:42:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:39 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 Jun 03 14:42:39 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:40 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764" returned: 0 in 0.826s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:40 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.info Jun 03 14:42:40 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:41 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.info" returned: 0 in 0.732s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:41 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:41 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.info Jun 03 14:42:41 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:41 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.info" returned: 0 in 0.707s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Acquiring lock "cinder-quobyte-f37377cd-bf11-41db-aa10-4a2d0ad8b378" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Lock "cinder-quobyte-f37377cd-bf11-41db-aa10-4a2d0ad8b378" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] snapshot: 3780d960-4d90-40f3-b538-328e9dfe6764, volume: f37377cd-bf11-41db-aa10-4a2d0ad8b378, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c41b916-e53c-4eb3-b0c9-f8f8cd1c4de1]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:41 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 Jun 03 14:42:41 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:42 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764" returned: 0 in 0.828s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba890ce5-7d29-4635-801b-117ffea1c56a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:42:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 14:42:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 14:42:42 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d279596-2433-47f6-8436-5c2f4af5a388]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:42 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a Jun 03 14:42:42 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:43 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a" returned: 0 in 0.827s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:43 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 14:42:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:43 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 Jun 03 14:42:43 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-fe41f3ee-3fc4-4354-9135-f3991a8f2800 req-68a32559-50fd-4291-9b88-dd65ed8413a7 tempest-TaggedAttachmentsTest-636751611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:49 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378" returned: 0 in 6.470s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:49 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[191e536d-14d8-4515-8467-524fd90cc57f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:50 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a Jun 03 14:42:50 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:51 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a" returned: 0 in 1.106s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:42:51 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Converted 1024.00 MB image at 158.26 MB/s Jun 03 14:42:51 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:51 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 Jun 03 14:42:51 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:51 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378" returned: 0 in 0.634s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Lock "cinder-quobyte-f37377cd-bf11-41db-aa10-4a2d0ad8b378" released by "_copy_volume_from_snapshot" :: held 9.968s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Acquiring lock "cinder-quobyte-3780d960-4d90-40f3-b538-328e9dfe6764" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Lock "cinder-quobyte-3780d960-4d90-40f3-b538-328e9dfe6764" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Deleting offline snapshot 3780d960-4d90-40f3-b538-328e9dfe6764 of volume ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] snapshot_file for this snap is: volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[635afc5d-63d2-4596-9bcb-fa9260f7bd4d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:51 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 Jun 03 14:42:51 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:52 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764" returned: 0 in 0.739s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba890ce5-7d29-4635-801b-117ffea1c56a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:42:52 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fb39dd-6cfe-4515-ab86-e1753ff19534]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:52 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a Jun 03 14:42:52 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:53 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a" returned: 0 in 0.733s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:53 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 Jun 03 14:42:53 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:42:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:42:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:42:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:53 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:42:53 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:54 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764" returned: 0 in 0.945s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:54 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764 Jun 03 14:42:54 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:54 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.721s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 8 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:42:54 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a.3780d960-4d90-40f3-b538-328e9dfe6764" returned: 0 in 0.608s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Lock "cinder-quobyte-3780d960-4d90-40f3-b538-328e9dfe6764" released by "_delete_snapshot" :: held 3.148s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.492s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-fe41f3ee-3fc4-4354-9135-f3991a8f2800 req-68a32559-50fd-4291-9b88-dd65ed8413a7 tempest-TaggedAttachmentsTest-636751611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.449s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2fdfc0-8826-4bcb-a74a-b0771e16cc76]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-fe41f3ee-3fc4-4354-9135-f3991a8f2800 req-68a32559-50fd-4291-9b88-dd65ed8413a7 tempest-TaggedAttachmentsTest-636751611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:55 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-3eabf1bb-00c7-41ff-87df-b8d4f93df039 tempest-GroupsV314Test-363651425 None] Create group from source-group-8a456375-af1d-42df-8527-d2f0053d6518 completed successfully. Jun 03 14:42:55 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 Jun 03 14:42:55 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:55 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-fe41f3ee-3fc4-4354-9135-f3991a8f2800 req-68a32559-50fd-4291-9b88-dd65ed8413a7 tempest-TaggedAttachmentsTest-636751611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58" returned: 0 in 0.732s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-fe41f3ee-3fc4-4354-9135-f3991a8f2800 req-68a32559-50fd-4291-9b88-dd65ed8413a7 tempest-TaggedAttachmentsTest-636751611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.761s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-fe41f3ee-3fc4-4354-9135-f3991a8f2800 req-68a32559-50fd-4291-9b88-dd65ed8413a7 tempest-TaggedAttachmentsTest-636751611 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '057caa9a-ce08-4cf4-9d2a-fdf40a2cec12', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:42:55 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-fe41f3ee-3fc4-4354-9135-f3991a8f2800 req-68a32559-50fd-4291-9b88-dd65ed8413a7 tempest-TaggedAttachmentsTest-636751611 None] attachment_update completed successfully. Jun 03 14:42:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Acquiring lock "cinder-quobyte-f37377cd-bf11-41db-aa10-4a2d0ad8b378" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:42:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Lock "cinder-quobyte-f37377cd-bf11-41db-aa10-4a2d0ad8b378" acquired by "delete_volume" :: waited 0.033s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:42:56 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f0a3fc-a532-4471-b068-ffc230464b0a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:42:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:56 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 Jun 03 14:42:56 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:57 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378" returned: 0 in 1.179s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:57 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378 Jun 03 14:42:57 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:58 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f37377cd-bf11-41db-aa10-4a2d0ad8b378" returned: 0 in 0.727s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Lock "cinder-quobyte-f37377cd-bf11-41db-aa10-4a2d0ad8b378" released by "delete_volume" :: held 2.036s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:42:58 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Created reservations ['58d37184-b05e-4a7b-9470-f4f98df9e884'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:42:58 devstack cinder-volume[86614]: WARNING cinder.quota [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1466150234 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1466150234, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:42:58 devstack cinder-volume[86614]: WARNING cinder.quota [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1466150234 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1466150234, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:42:58 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Created reservations ['fb45e246-b574-44a1-a49f-9cec044f5618', '16e37211-ff92-40da-8999-c6b914534485', 'dea545a8-17ac-4146-998f-2e7f7d2e40dd', '263c4d9f-b79d-4801-9f55-6539c0795065'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:42:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:42:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:42:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:42:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:42:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:42:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:42:58 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:42:58 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:42:59 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Jun 03 14:42:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.812s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:42:59 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:42:59 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8f76dbce-ec48-4db2-8402-c30095676479 tempest-GroupsV314Test-363651425 None] Delete group completed successfully. Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Acquiring lock "cinder-quobyte-ba890ce5-7d29-4635-801b-117ffea1c56a" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Lock "cinder-quobyte-ba890ce5-7d29-4635-801b-117ffea1c56a" acquired by "delete_volume" :: waited 0.045s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8462eaf-9eac-4f0e-acc3-5705da96383b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Flow 'volume_create_manager' (95a41beb-2c94-485c-be01-a8cb1932f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e199f9-0316-4844-9133-417895a3be51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:00 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a Jun 03 14:43:00 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e199f9-0316-4844-9133-417895a3be51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2034573371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2ac678-db78-4901-baaa-02bbb5b05a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a1bf175c3d46ceb131bb4703b93b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:00Z,use_quota=True,user_id='5af7aaeb655a431ca07e5dfdec89f363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98df4bb5-e2ec-44fb-89b7-09dde032a9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98df4bb5-e2ec-44fb-89b7-09dde032a9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1deaf8ea-b70b-493f-87b1-7fc2ee3cdfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1deaf8ea-b70b-493f-87b1-7fc2ee3cdfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d2ac678-db78-4901-baaa-02bbb5b05a88', 'volume_name': 'volume-0d2ac678-db78-4901-baaa-02bbb5b05a88', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d80575-eadd-4f5e-b6d3-eadb4e1798b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d80575-eadd-4f5e-b6d3-eadb4e1798b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5401e92-ff04-4d2d-a3d5-a666f90e168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:00 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Volume 0d2ac678-db78-4901-baaa-02bbb5b05a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d2ac678-db78-4901-baaa-02bbb5b05a88', 'volume_size': 1} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2034573371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2ac678-db78-4901-baaa-02bbb5b05a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a1bf175c3d46ceb131bb4703b93b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:00Z,use_quota=True,user_id='5af7aaeb655a431ca07e5dfdec89f363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Creating volume 0d2ac678-db78-4901-baaa-02bbb5b05a88 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:43:00 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:43:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:00 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88 1073741824 Jun 03 14:43:00 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:01 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a" returned: 0 in 1.176s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:01 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a Jun 03 14:43:01 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:01 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88 1073741824" returned: 0 in 1.280s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:02 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88 Jun 03 14:43:02 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:02 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ba890ce5-7d29-4635-801b-117ffea1c56a" returned: 0 in 1.331s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Lock "cinder-quobyte-ba890ce5-7d29-4635-801b-117ffea1c56a" released by "delete_volume" :: held 2.639s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:02 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Created reservations ['fb49da75-634c-499a-9c81-778e1a57713e'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Created reservations ['4137f7af-f8e3-47b0-92ed-ed589b727713', 'ede711c3-3a9a-4591-b3bf-1a41a465455c', '276707d3-c989-4812-b2fb-16326b090442', '2e09bbe3-c829-4e0a-bebd-1c1c66bda59c'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:43:03 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88" returned: 0 in 1.144s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] <== create_volume: return (2532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.537s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5401e92-ff04-4d2d-a3d5-a666f90e168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2ac678-db78-4901-baaa-02bbb5b05a88', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb6997b-cdd9-4496-9830-f8eaac742cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:03 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Volume volume-0d2ac678-db78-4901-baaa-02bbb5b05a88 (0d2ac678-db78-4901-baaa-02bbb5b05a88): created successfully Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb6997b-cdd9-4496-9830-f8eaac742cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Flow 'volume_create_manager' (95a41beb-2c94-485c-be01-a8cb1932f816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b33c3e05-7ecf-4c84-bf25-ba80ae5b877f tempest-VolumesAdminNegativeTest-588164428 None] Created volume successfully. Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:03 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:43:03 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:03 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.701s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:03 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:43:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5ebafc40-370a-401c-b321-4094eca665fa tempest-GroupsV314Test-363651425 None] Delete group completed successfully. Jun 03 14:43:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Acquiring lock "cinder-0d2ac678-db78-4901-baaa-02bbb5b05a88-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Lock "cinder-0d2ac678-db78-4901-baaa-02bbb5b05a88-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Acquiring lock "cinder-quobyte-0d2ac678-db78-4901-baaa-02bbb5b05a88" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Lock "cinder-quobyte-0d2ac678-db78-4901-baaa-02bbb5b05a88" acquired by "delete_volume" :: waited 0.035s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:04 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac9b0ce-efaf-4863-81f8-7f5251527056]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:43:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:04 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-ed1a969d-2418-4432-b6a2-167441d37f61 req-cd9a035c-4a65-442a-a118-9f4e1a21194a tempest-TaggedAttachmentsTest-636751611 None] Terminate volume connection completed successfully. Jun 03 14:43:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-ed1a969d-2418-4432-b6a2-167441d37f61 req-cd9a035c-4a65-442a-a118-9f4e1a21194a tempest-TaggedAttachmentsTest-636751611 None] Deleting attachment 057caa9a-ce08-4cf4-9d2a-fdf40a2cec12. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:43:04 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88 Jun 03 14:43:04 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:05 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88" returned: 0 in 1.302s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:05 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88 Jun 03 14:43:05 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:06 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0d2ac678-db78-4901-baaa-02bbb5b05a88" returned: 0 in 1.088s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Lock "cinder-quobyte-0d2ac678-db78-4901-baaa-02bbb5b05a88" released by "delete_volume" :: held 2.464s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:06 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=61,cinder:INSERT=13,cinder:UPDATE=62,cinder:DELETE=1 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:43:06 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=59,cinder:UPDATE=67,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:43:07 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Created reservations ['13b8ce06-071b-464c-876f-5b076fe4548b', 'a68e9389-686b-4232-988e-155638db8bac', '95348661-e370-4588-9e03-e670e818cd22', '53069aad-b078-4936-9aa0-3103b689e2ef'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:43:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:07 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:43:07 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:08 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.495s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:08 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:43:08 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Deleted volume successfully. Jun 03 14:43:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-de8fe09c-8752-4b17-b9ae-9e7c81be80f4 tempest-VolumesAdminNegativeTest-588164428 None] Lock "cinder-0d2ac678-db78-4901-baaa-02bbb5b05a88-delete_volume" released by "delete_volume" :: held 4.322s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:17 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=9 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:43:18 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:43:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Acquiring lock "cinder-6539fbe3-4fef-4ae2-8db4-b3d6de00df58-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Lock "cinder-6539fbe3-4fef-4ae2-8db4-b3d6de00df58-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Acquiring lock "cinder-quobyte-6539fbe3-4fef-4ae2-8db4-b3d6de00df58" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Lock "cinder-quobyte-6539fbe3-4fef-4ae2-8db4-b3d6de00df58" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e466d1-55fc-4802-bb07-e51e68e0e16b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:43:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:24 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 Jun 03 14:43:24 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:25 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58" returned: 0 in 0.783s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:25 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58 Jun 03 14:43:25 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:25 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6539fbe3-4fef-4ae2-8db4-b3d6de00df58" returned: 0 in 0.691s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Lock "cinder-quobyte-6539fbe3-4fef-4ae2-8db4-b3d6de00df58" released by "delete_volume" :: held 1.525s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:25 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Created reservations ['4039290e-74b6-4255-af2f-77ebb426f987', 'bef7f461-8bdd-437a-a43a-51c8e10f96c3', '212ceb6d-9d56-4e7f-af63-e21f762eae83', '4417ffd2-cfc2-4d4f-baea-cad6753bbc52'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:43:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:26 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:43:26 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:26 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.648s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:26 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:43:26 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Deleted volume successfully. Jun 03 14:43:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0cbf455f-1ed5-4234-8ce0-90b4fbb37bd7 tempest-TaggedAttachmentsTest-636751611 None] Lock "cinder-6539fbe3-4fef-4ae2-8db4-b3d6de00df58-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Flow 'volume_create_manager' (189c86be-2ef6-4108-83e6-c20c7fc0b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d25711-2f75-476c-bdb9-d1b45c897a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d25711-2f75-476c-bdb9-d1b45c897a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-617080287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7009d807-978d-4261-8ea3-64ad94f86f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62af91ef912846b3aa66ef720d64c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:33Z,use_quota=True,user_id='1a2d761f430a450db134bea650c6db61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e525d1b0-b80a-4a7e-825f-02d71b4bc778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e525d1b0-b80a-4a7e-825f-02d71b4bc778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b80543-0f19-4c11-a29c-3d96cea6af2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b80543-0f19-4c11-a29c-3d96cea6af2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7009d807-978d-4261-8ea3-64ad94f86f1c', 'volume_name': 'volume-7009d807-978d-4261-8ea3-64ad94f86f1c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f33831-5afc-4de9-a4af-0aca51b4ef67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f33831-5afc-4de9-a4af-0aca51b4ef67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf15893-594b-43b7-a931-b78ae9b4265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:33 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Volume 7009d807-978d-4261-8ea3-64ad94f86f1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7009d807-978d-4261-8ea3-64ad94f86f1c', 'volume_size': 1} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-617080287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7009d807-978d-4261-8ea3-64ad94f86f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62af91ef912846b3aa66ef720d64c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:33Z,use_quota=True,user_id='1a2d761f430a450db134bea650c6db61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Creating volume 7009d807-978d-4261-8ea3-64ad94f86f1c {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:43:33 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:43:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:33 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c 1073741824 Jun 03 14:43:33 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:34 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c 1073741824" returned: 0 in 1.017s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:34 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c Jun 03 14:43:34 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:35 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c" returned: 0 in 0.827s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:43:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf15893-594b-43b7-a931-b78ae9b4265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7009d807-978d-4261-8ea3-64ad94f86f1c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ce3544-b23e-475d-b1d7-ba1bab964764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:35 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Volume volume-7009d807-978d-4261-8ea3-64ad94f86f1c (7009d807-978d-4261-8ea3-64ad94f86f1c): created successfully Jun 03 14:43:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ce3544-b23e-475d-b1d7-ba1bab964764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Flow 'volume_create_manager' (189c86be-2ef6-4108-83e6-c20c7fc0b06f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:35 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5102ed29-5482-4a71-b55d-8d44198ca07d tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Created volume successfully. Jun 03 14:43:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Creating offline snapshot 386d3a53-09d0-4a26-8c30-f5f54b481900 of volume 7009d807-978d-4261-8ea3-64ad94f86f1c {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:43:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c467216-5aa5-47bf-b2d8-7caa4a336876]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:43:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:36 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c Jun 03 14:43:36 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:37 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c" returned: 0 in 1.062s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:37 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 1G Jun 03 14:43:37 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Flow 'volume_create_manager' (ce4bca6c-4517-4650-9d26-ea78cae7bddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b8c960-af20-43ec-8635-12b5e67fd964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b8c960-af20-43ec-8635-12b5e67fd964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-563292209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dff7db15b46046e387f1a8e04095fea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:38Z,use_quota=True,user_id='986d860b0e0a45f39c7df7e217f1f184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311e2357-cdd7-4c75-a043-d9819c1dae31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311e2357-cdd7-4c75-a043-d9819c1dae31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adfb2bf-05a6-4b33-886f-2decca7635ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adfb2bf-05a6-4b33-886f-2decca7635ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca', 'volume_name': 'volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87156981-4e50-482f-82cf-824a3efab971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87156981-4e50-482f-82cf-824a3efab971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8807fd-82b5-4088-ade3-116a8479d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:38 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Volume ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca', 'volume_size': 1} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:38 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 1G" returned: 0 in 1.031s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7009d807-978d-4261-8ea3-64ad94f86f1c -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:38 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7009d807-978d-4261-8ea3-64ad94f86f1c -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 Jun 03 14:43:38 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:39 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7009d807-978d-4261-8ea3-64ad94f86f1c -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900" returned: 0 in 0.673s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:39 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 is being set with open permissions: ugo+rw Jun 03 14:43:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:39 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 Jun 03 14:43:39 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:40 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900" returned: 0 in 0.707s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:40 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.info Jun 03 14:43:40 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:40 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.info" returned: 0 in 0.642s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:40 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.info is being set with open permissions: ugo+rw Jun 03 14:43:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:40 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.info Jun 03 14:43:40 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:41 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.info" returned: 0 in 0.631s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.883s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.963s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-563292209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dff7db15b46046e387f1a8e04095fea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:38Z,use_quota=True,user_id='986d860b0e0a45f39c7df7e217f1f184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Creating volume ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:43:41 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:43:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:41 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca 1073741824 Jun 03 14:43:41 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:41 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d28cf0d4-ddb3-4a19-88cd-a0dfbb8857d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Create snapshot completed successfully Jun 03 14:43:42 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca 1073741824" returned: 0 in 0.943s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Acquiring lock "cinder-386d3a53-09d0-4a26-8c30-f5f54b481900-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:42 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca Jun 03 14:43:42 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "cinder-386d3a53-09d0-4a26-8c30-f5f54b481900-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Acquiring lock "cinder-quobyte-7009d807-978d-4261-8ea3-64ad94f86f1c" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "cinder-quobyte-7009d807-978d-4261-8ea3-64ad94f86f1c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Acquiring lock "cinder-quobyte-386d3a53-09d0-4a26-8c30-f5f54b481900" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "cinder-quobyte-386d3a53-09d0-4a26-8c30-f5f54b481900" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Deleting offline snapshot 386d3a53-09d0-4a26-8c30-f5f54b481900 of volume 7009d807-978d-4261-8ea3-64ad94f86f1c {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] snapshot_file for this snap is: volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d980dcb-1ace-4521-b2db-3edd1e51cbc7]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:43:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:42 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 Jun 03 14:43:42 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:43 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca" returned: 0 in 0.689s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8807fd-82b5-4088-ade3-116a8479d030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af9fd25-9d24-45a6-bad5-ec372e2b8ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:43 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Volume volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca (ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca): created successfully Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af9fd25-9d24-45a6-bad5-ec372e2b8ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Flow 'volume_create_manager' (ce4bca6c-4517-4650-9d26-ea78cae7bddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:43 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-bea097a9-cc98-42f8-b634-e36ea6057cf9 req-77ccde60-9e13-449c-a7e5-dca7c67080a5 tempest-VolumesGetTestJSON-1876800182 None] Created volume successfully. Jun 03 14:43:43 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900" returned: 0 in 0.815s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7009d807-978d-4261-8ea3-64ad94f86f1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab0b52e-1907-472e-b87e-33189695bae1]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:43:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:43 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c Jun 03 14:43:43 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:44 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c" returned: 0 in 0.713s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:44 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 Jun 03 14:43:44 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Acquiring lock "cinder-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Lock "cinder-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Acquiring lock "cinder-quobyte-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Lock "cinder-quobyte-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca" acquired by "delete_volume" :: waited 0.040s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:44 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[69984603-9ead-4dcd-b536-1128eb3b8b71]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:43:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:44 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca Jun 03 14:43:44 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:45 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900" returned: 0 in 0.771s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:45 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900 Jun 03 14:43:45 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:45 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca" returned: 0 in 0.736s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:45 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca Jun 03 14:43:45 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:45 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c.386d3a53-09d0-4a26-8c30-f5f54b481900" returned: 0 in 0.585s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:45 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "cinder-quobyte-386d3a53-09d0-4a26-8c30-f5f54b481900" released by "_delete_snapshot" :: held 3.057s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:45 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "cinder-quobyte-7009d807-978d-4261-8ea3-64ad94f86f1c" released by "delete_snapshot" :: held 3.096s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:45 devstack cinder-volume[86614]: WARNING cinder.quota [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:43:45 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Created reservations ['984b1a5e-1f52-48fe-9155-14be4393edf9', '0d96373c-2fb7-4ce9-85ff-ee24e7100e00', '3656484b-6475-4868-a807-20c0c01ae562', 'db14873c-7645-4d0d-ac6f-7b4597e66d2a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:43:45 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Delete snapshot completed successfully. Jun 03 14:43:45 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5d2f43a-c63b-467c-a2fd-f7cca81cdc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "cinder-386d3a53-09d0-4a26-8c30-f5f54b481900-delete_snapshot" released by "delete_snapshot" :: held 3.318s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:46 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca" returned: 0 in 0.650s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Lock "cinder-quobyte-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca" released by "delete_volume" :: held 1.452s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG cinder.quota [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Created reservations ['bc6e50a9-7186-4c80-9684-545be94bb2b2', 'd4ce095f-6776-448c-b1b2-6e51a202ae9a', '0642a74f-8623-435d-ae59-43b98a8e10ee', '281d3712-82f8-4687-a6b7-0161817cd512'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:46 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:43:46 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:46 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.565s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG cinder.manager [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:43:46 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Deleted volume successfully. Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-76a03ab1-257d-44d3-8913-49844c5e345f req-73fb7e08-3b1f-4ccc-9a1f-794ef235b333 tempest-VolumesGetTestJSON-1876800182 None] Lock "cinder-ddeabbf4-2d94-4cd0-bd80-cfacb6e530ca-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:46 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Acquiring lock "cinder-7009d807-978d-4261-8ea3-64ad94f86f1c-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:47 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "cinder-7009d807-978d-4261-8ea3-64ad94f86f1c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:47 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Acquiring lock "cinder-quobyte-7009d807-978d-4261-8ea3-64ad94f86f1c" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:43:47 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "cinder-quobyte-7009d807-978d-4261-8ea3-64ad94f86f1c" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:43:47 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b31805b-cea3-4ece-a0aa-a84095d76b6e]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:43:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:47 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c Jun 03 14:43:47 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:48 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c" returned: 0 in 0.956s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:48 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c Jun 03 14:43:48 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:48 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7009d807-978d-4261-8ea3-64ad94f86f1c" returned: 0 in 0.660s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:48 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "cinder-quobyte-7009d807-978d-4261-8ea3-64ad94f86f1c" released by "delete_volume" :: held 1.705s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:48 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Created reservations ['627b5c43-8660-4d1a-ab66-aa988a2b5280', '77c19968-53dd-4601-8da4-9ab5592eeb88', 'e6c77d8d-88fa-4f60-add1-846d2b955421', '850c894e-ef70-4ae0-a424-2a7cc197147f'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:43:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:49 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:49 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:49 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:43:49 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:49 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.717s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:49 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:43:49 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Deleted volume successfully. Jun 03 14:43:49 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e628d51-882b-4c19-955b-f6daa9d983c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-411711127 None] Lock "cinder-7009d807-978d-4261-8ea3-64ad94f86f1c-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Flow 'volume_create_manager' (7ef06bca-44d2-4b6a-889b-f4f1346730dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c90b3c8-d1f3-4ef9-8d4f-f019cc5eeb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c90b3c8-d1f3-4ef9-8d4f-f019cc5eeb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1227162959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a43e4af-b8d2-485b-899c-b936d63851e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21267c8232a84d77825c9c68b1d9b5ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:52Z,use_quota=True,user_id='fd5054ed8cfa434480280baae23b18d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5cfec1-b8ed-42c7-ab2a-1aa70491c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5cfec1-b8ed-42c7-ab2a-1aa70491c122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4714df-1aed-44d4-8e2b-82e2bccf5aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4714df-1aed-44d4-8e2b-82e2bccf5aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a43e4af-b8d2-485b-899c-b936d63851e3', 'volume_name': 'volume-9a43e4af-b8d2-485b-899c-b936d63851e3', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7055bf-2218-4087-8efe-763483445320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7055bf-2218-4087-8efe-763483445320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596f28e9-2acd-418f-8b54-3ee6c1194dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:52 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Volume 9a43e4af-b8d2-485b-899c-b936d63851e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a43e4af-b8d2-485b-899c-b936d63851e3', 'volume_size': 1} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1227162959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a43e4af-b8d2-485b-899c-b936d63851e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21267c8232a84d77825c9c68b1d9b5ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:52Z,use_quota=True,user_id='fd5054ed8cfa434480280baae23b18d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Creating volume 9a43e4af-b8d2-485b-899c-b936d63851e3 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:43:52 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:43:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:52 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3 1073741824 Jun 03 14:43:52 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:53 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3 1073741824" returned: 0 in 0.892s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:53 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3 Jun 03 14:43:53 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:43:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:53 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:43:53 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Flow 'volume_create_manager' (c86bed8f-5d30-4b7a-a4c8-b48af44c4626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85922beb-2199-43e1-924b-8d65d8cd28ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85922beb-2199-43e1-924b-8d65d8cd28ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-387846518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b5233e-0596-46a3-93e4-fc11fd0a5a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd4fbd50ac34e36be18dbbc4f840b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:54Z,use_quota=True,user_id='90641535c0cb4ae8ba381609722ca799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f08bda4-877d-4791-9c49-6cbc2a1cb04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f08bda4-877d-4791-9c49-6cbc2a1cb04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f40980-03ae-490f-9917-e1ddb9da0f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f40980-03ae-490f-9917-e1ddb9da0f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b5233e-0596-46a3-93e4-fc11fd0a5a59', 'volume_name': 'volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:54 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d482ad54-9ce6-4225-adff-8edec63463ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d482ad54-9ce6-4225-adff-8edec63463ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565965c6-168f-41d3-bf5f-21ac2750e0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:54 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Volume f2b5233e-0596-46a3-93e4-fc11fd0a5a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59', 'volume_size': 1} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3" returned: 0 in 0.984s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-387846518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b5233e-0596-46a3-93e4-fc11fd0a5a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd4fbd50ac34e36be18dbbc4f840b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:54Z,use_quota=True,user_id='90641535c0cb4ae8ba381609722ca799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Creating volume f2b5233e-0596-46a3-93e4-fc11fd0a5a59 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:43:54 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596f28e9-2acd-418f-8b54-3ee6c1194dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a43e4af-b8d2-485b-899c-b936d63851e3', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:54 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 1073741824 Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc78306-210e-45af-be0a-eb97afc8a6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:54 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:54 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Volume volume-9a43e4af-b8d2-485b-899c-b936d63851e3 (9a43e4af-b8d2-485b-899c-b936d63851e3): created successfully Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc78306-210e-45af-be0a-eb97afc8a6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:54 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Flow 'volume_create_manager' (7ef06bca-44d2-4b6a-889b-f4f1346730dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.008s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:43:54 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-29a37b09-e820-4bcf-bf76-fd7a22785847 tempest-VolumesTestJSON-377607662 None] Created volume successfully. Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 8 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:43:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:43:55 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 1073741824" returned: 0 in 0.920s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:55 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 Jun 03 14:43:55 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:56 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59" returned: 0 in 0.772s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565965c6-168f-41d3-bf5f-21ac2750e0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5cbf86-17dd-4f4c-8540-7a2229901209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:56 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Volume volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 (f2b5233e-0596-46a3-93e4-fc11fd0a5a59): created successfully Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5cbf86-17dd-4f4c-8540-7a2229901209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Flow 'volume_create_manager' (c86bed8f-5d30-4b7a-a4c8-b48af44c4626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Flow 'volume_create_manager' (1ec63972-e091-42f9-8a9e-0bde157c6ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b090ded-eaf4-4252-acbc-c08567de3b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a654df22-e217-4864-b711-da20db1844e9 tempest-AttachVolumeNegativeTest-1795286255 None] Created volume successfully. Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b090ded-eaf4-4252-acbc-c08567de3b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1063032632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95037aeb-865e-4dca-a0b3-1817efb745ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21267c8232a84d77825c9c68b1d9b5ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:56Z,use_quota=True,user_id='fd5054ed8cfa434480280baae23b18d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbc38ef-9375-4540-931d-40149e06463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbc38ef-9375-4540-931d-40149e06463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884687a9-7e1e-404e-a730-80c1766b3df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884687a9-7e1e-404e-a730-80c1766b3df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95037aeb-865e-4dca-a0b3-1817efb745ba', 'volume_name': 'volume-95037aeb-865e-4dca-a0b3-1817efb745ba', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df6d9ca-4922-4560-a61e-43b4235b3c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df6d9ca-4922-4560-a61e-43b4235b3c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f70784b-6ad6-4898-b76b-7e91bdd874a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:56 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Volume 95037aeb-865e-4dca-a0b3-1817efb745ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95037aeb-865e-4dca-a0b3-1817efb745ba', 'volume_size': 1} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1063032632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95037aeb-865e-4dca-a0b3-1817efb745ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21267c8232a84d77825c9c68b1d9b5ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:56Z,use_quota=True,user_id='fd5054ed8cfa434480280baae23b18d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Creating volume 95037aeb-865e-4dca-a0b3-1817efb745ba {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:43:56 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:43:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:56 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba 1073741824 Jun 03 14:43:56 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:57 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba 1073741824" returned: 0 in 0.990s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:57 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba Jun 03 14:43:57 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:58 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba" returned: 0 in 0.583s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:43:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f70784b-6ad6-4898-b76b-7e91bdd874a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95037aeb-865e-4dca-a0b3-1817efb745ba', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4291d518-e9a7-4bbe-9151-313f8e15499b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:58 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Volume volume-95037aeb-865e-4dca-a0b3-1817efb745ba (95037aeb-865e-4dca-a0b3-1817efb745ba): created successfully Jun 03 14:43:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4291d518-e9a7-4bbe-9151-313f8e15499b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Flow 'volume_create_manager' (1ec63972-e091-42f9-8a9e-0bde157c6ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:58 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-340085c8-fcd6-416a-9525-987a195da658 tempest-VolumesTestJSON-377607662 None] Created volume successfully. Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Flow 'volume_create_manager' (ec782c43-bc29-4b41-a1ed-78b84ff2ab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63b232b-344e-4876-a3ad-467de5d7abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63b232b-344e-4876-a3ad-467de5d7abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-207272443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780c5033-21d4-43ab-ad45-4520285b0431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd091b3a8394e09b4d912584e62684c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:59Z,use_quota=True,user_id='0bb9cf23222d4d3796c27bfb37433e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1eebefc-a282-4fdd-8936-0ebc381019c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1eebefc-a282-4fdd-8936-0ebc381019c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dd4a2f-4f72-4e9e-899d-5f880a91e35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dd4a2f-4f72-4e9e-899d-5f880a91e35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '780c5033-21d4-43ab-ad45-4520285b0431', 'volume_name': 'volume-780c5033-21d4-43ab-ad45-4520285b0431', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe78f22-ca6f-442a-a4e4-4104bc53f318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe78f22-ca6f-442a-a4e4-4104bc53f318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0db0e20-e82f-42c7-843e-85dfd7547308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:59 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Volume 780c5033-21d4-43ab-ad45-4520285b0431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-780c5033-21d4-43ab-ad45-4520285b0431', 'volume_size': 1} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-207272443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780c5033-21d4-43ab-ad45-4520285b0431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd091b3a8394e09b4d912584e62684c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:59Z,use_quota=True,user_id='0bb9cf23222d4d3796c27bfb37433e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Creating volume 780c5033-21d4-43ab-ad45-4520285b0431 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:43:59 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:43:59 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431 1073741824 Jun 03 14:43:59 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Flow 'volume_create_manager' (af1fd24d-0595-42f7-8ce2-32df1974425e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1e1d4a-8a53-4662-95e7-705fce11d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1e1d4a-8a53-4662-95e7-705fce11d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-487709752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1685946d-b5ff-486e-bccb-367566cbfe5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21267c8232a84d77825c9c68b1d9b5ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:59Z,use_quota=True,user_id='fd5054ed8cfa434480280baae23b18d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa3716c-1761-4ca2-9cf1-f2a67a29834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa3716c-1761-4ca2-9cf1-f2a67a29834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fd1bfa-0e73-4382-90ec-df1160dda6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fd1bfa-0e73-4382-90ec-df1160dda6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1685946d-b5ff-486e-bccb-367566cbfe5b', 'volume_name': 'volume-1685946d-b5ff-486e-bccb-367566cbfe5b', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2559ac12-d252-422c-9f70-9ba88b0553c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2559ac12-d252-422c-9f70-9ba88b0553c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efc7145-8c36-45a7-9487-43cf2e7588cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:43:59 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Volume 1685946d-b5ff-486e-bccb-367566cbfe5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1685946d-b5ff-486e-bccb-367566cbfe5b', 'volume_size': 1} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-99335ad9-0398-4cb5-b937-891686a0608d req-31c25167-fa36-4995-9b96-da4060d4d521 tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:43:59 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431 1073741824" returned: 0 in 0.781s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:43:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:43:59 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431 Jun 03 14:43:59 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:00 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431" returned: 0 in 0.572s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-487709752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1685946d-b5ff-486e-bccb-367566cbfe5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21267c8232a84d77825c9c68b1d9b5ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:43:59Z,use_quota=True,user_id='fd5054ed8cfa434480280baae23b18d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Creating volume 1685946d-b5ff-486e-bccb-367566cbfe5b {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:44:00 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:00 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b 1073741824 Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0db0e20-e82f-42c7-843e-85dfd7547308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780c5033-21d4-43ab-ad45-4520285b0431', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:00 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc696aa3-3d89-4298-ab10-cbd5284d1b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:00 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Volume volume-780c5033-21d4-43ab-ad45-4520285b0431 (780c5033-21d4-43ab-ad45-4520285b0431): created successfully Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc696aa3-3d89-4298-ab10-cbd5284d1b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Flow 'volume_create_manager' (ec782c43-bc29-4b41-a1ed-78b84ff2ab9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:00 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-3614babd-f48e-4043-a403-d6ec40487b40 tempest-VolumesTransfersV357Test-53462024 None] Created volume successfully. Jun 03 14:44:01 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b 1073741824" returned: 0 in 0.805s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:01 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b Jun 03 14:44:01 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:01 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-816069bc-7ed5-41dd-a3db-5861a2b78236 tempest-VolumesTransfersV357Test-2112074673 None] Transfer volume completed successfully. Jun 03 14:44:02 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b" returned: 0 in 0.635s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-99335ad9-0398-4cb5-b937-891686a0608d req-31c25167-fa36-4995-9b96-da4060d4d521 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.317s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efc7145-8c36-45a7-9487-43cf2e7588cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1685946d-b5ff-486e-bccb-367566cbfe5b', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8101cfbf-0e86-41cf-96c2-5fe0d98b5dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c41c4b-3190-48c5-ba5c-df31bb2d24de]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-99335ad9-0398-4cb5-b937-891686a0608d req-31c25167-fa36-4995-9b96-da4060d4d521 tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:02 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Volume volume-1685946d-b5ff-486e-bccb-367566cbfe5b (1685946d-b5ff-486e-bccb-367566cbfe5b): created successfully Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8101cfbf-0e86-41cf-96c2-5fe0d98b5dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Flow 'volume_create_manager' (af1fd24d-0595-42f7-8ce2-32df1974425e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:02 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-27787a1e-04bb-4946-9e37-c8b1e473502b tempest-VolumesTestJSON-377607662 None] Created volume successfully. Jun 03 14:44:02 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 Jun 03 14:44:02 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Acquiring lock "cinder-780c5033-21d4-43ab-ad45-4520285b0431-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:02 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-99335ad9-0398-4cb5-b937-891686a0608d req-31c25167-fa36-4995-9b96-da4060d4d521 tempest-AttachVolumeNegativeTest-1795286255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59" returned: 0 in 0.881s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-99335ad9-0398-4cb5-b937-891686a0608d req-31c25167-fa36-4995-9b96-da4060d4d521 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.922s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Lock "cinder-780c5033-21d4-43ab-ad45-4520285b0431-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:03 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Acquiring lock "cinder-quobyte-780c5033-21d4-43ab-ad45-4520285b0431" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-99335ad9-0398-4cb5-b937-891686a0608d req-31c25167-fa36-4995-9b96-da4060d4d521 tempest-AttachVolumeNegativeTest-1795286255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '403a2e48-ed51-4ef6-8e03-09ab7847b7ff', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:44:03 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Lock "cinder-quobyte-780c5033-21d4-43ab-ad45-4520285b0431" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:03 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[555d0ae4-571b-4358-a847-05235071b9d0]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:44:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-99335ad9-0398-4cb5-b937-891686a0608d req-31c25167-fa36-4995-9b96-da4060d4d521 tempest-AttachVolumeNegativeTest-1795286255 None] attachment_update completed successfully. Jun 03 14:44:03 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431 Jun 03 14:44:03 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:03 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Acquiring lock "cinder-1685946d-b5ff-486e-bccb-367566cbfe5b-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:03 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Lock "cinder-1685946d-b5ff-486e-bccb-367566cbfe5b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:03 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Acquiring lock "cinder-quobyte-1685946d-b5ff-486e-bccb-367566cbfe5b" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Lock "cinder-quobyte-1685946d-b5ff-486e-bccb-367566cbfe5b" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[23057663-68c4-479f-9b85-41f6862df374]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:04 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431" returned: 0 in 0.978s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:04 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431 Jun 03 14:44:04 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:04 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b Jun 03 14:44:04 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:04 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-780c5033-21d4-43ab-ad45-4520285b0431" returned: 0 in 0.685s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Lock "cinder-quobyte-780c5033-21d4-43ab-ad45-4520285b0431" released by "delete_volume" :: held 1.719s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:04 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b" returned: 0 in 0.739s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:04 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b Jun 03 14:44:04 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Created reservations ['b3510fda-3f8c-43fa-bc44-1badd4766e3b', '2db114a8-a66d-4a20-83ae-084904052ea2', '777057d0-4644-46b0-83f8-ae7dac45ec5b', 'caa3b701-8f27-4b18-9f1a-17f54ac0cdec'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:04 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:04 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:05 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1685946d-b5ff-486e-bccb-367566cbfe5b" returned: 0 in 0.646s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Lock "cinder-quobyte-1685946d-b5ff-486e-bccb-367566cbfe5b" released by "delete_volume" :: held 1.434s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Created reservations ['fb1a580d-01d9-45b1-9cc5-c3aa65d61051', '890184fe-4b43-4093-b5d7-337df43e9b17', '6f9e6b73-1541-4587-a47b-d45d5efffc33', '2d01bb4b-4882-49e2-8207-f11ab917008f'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:44:05 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.625s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:05 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Deleted volume successfully. Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b8e1fe78-5919-4721-8ad0-a6cb71f463a9 tempest-VolumesTransfersV357Test-858039045 None] Lock "cinder-780c5033-21d4-43ab-ad45-4520285b0431-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:05 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:05 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Flow 'volume_create_manager' (c0a563ae-b9e5-4087-9bf4-d5c023646364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78a175a-23ca-4e95-a5e7-69b4988a3f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78a175a-23ca-4e95-a5e7-69b4988a3f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-969164742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137eb764-50d1-4a7d-900e-f71a5a31f331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd091b3a8394e09b4d912584e62684c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:06Z,use_quota=True,user_id='0bb9cf23222d4d3796c27bfb37433e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d0de68-b2bd-4ad7-94c1-e0318a5519ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d0de68-b2bd-4ad7-94c1-e0318a5519ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40be9ae4-6929-40bc-8149-63a5c2f19ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40be9ae4-6929-40bc-8149-63a5c2f19ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '137eb764-50d1-4a7d-900e-f71a5a31f331', 'volume_name': 'volume-137eb764-50d1-4a7d-900e-f71a5a31f331', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c642b5f-96fd-408f-987b-f169ab405f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c642b5f-96fd-408f-987b-f169ab405f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a01fb53-db7a-4121-8d8f-66d2eaac4530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:05 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Volume 137eb764-50d1-4a7d-900e-f71a5a31f331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-137eb764-50d1-4a7d-900e-f71a5a31f331', 'volume_size': 1} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-969164742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137eb764-50d1-4a7d-900e-f71a5a31f331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd091b3a8394e09b4d912584e62684c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:06Z,use_quota=True,user_id='0bb9cf23222d4d3796c27bfb37433e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Creating volume 137eb764-50d1-4a7d-900e-f71a5a31f331 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:44:05 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:44:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:05 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331 1073741824 Jun 03 14:44:05 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Acquiring lock "cinder-95037aeb-865e-4dca-a0b3-1817efb745ba-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Lock "cinder-95037aeb-865e-4dca-a0b3-1817efb745ba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Acquiring lock "cinder-quobyte-95037aeb-865e-4dca-a0b3-1817efb745ba" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Lock "cinder-quobyte-95037aeb-865e-4dca-a0b3-1817efb745ba" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf9ecda-d3c3-43c2-8e07-f0997dd25848]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:06 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.746s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:06 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Deleted volume successfully. Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3775c328-1d5a-4495-954f-70b90bf31749 tempest-VolumesTestJSON-377607662 None] Lock "cinder-1685946d-b5ff-486e-bccb-367566cbfe5b-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:06 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba Jun 03 14:44:06 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:06 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331 1073741824" returned: 0 in 0.848s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:06 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331 Jun 03 14:44:06 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:07 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba" returned: 0 in 0.770s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:07 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba Jun 03 14:44:07 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:07 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331" returned: 0 in 0.636s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a01fb53-db7a-4121-8d8f-66d2eaac4530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137eb764-50d1-4a7d-900e-f71a5a31f331', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcdfb19-3d81-4590-9696-c494c4c341c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:07 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Volume volume-137eb764-50d1-4a7d-900e-f71a5a31f331 (137eb764-50d1-4a7d-900e-f71a5a31f331): created successfully Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcdfb19-3d81-4590-9696-c494c4c341c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Flow 'volume_create_manager' (c0a563ae-b9e5-4087-9bf4-d5c023646364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:07 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1f03a143-b30c-4a73-93dd-91a55cf64079 tempest-VolumesTransfersV357Test-53462024 None] Created volume successfully. Jun 03 14:44:07 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-95037aeb-865e-4dca-a0b3-1817efb745ba" returned: 0 in 0.610s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Lock "cinder-quobyte-95037aeb-865e-4dca-a0b3-1817efb745ba" released by "delete_volume" :: held 1.427s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Created reservations ['8c248c5e-adf8-476c-85b0-825e1c683f01', 'c43ee292-68d8-40ad-bf09-68aa72cd9b9a', 'e4ecf9e6-47af-4b29-bca4-b6723462c03d', 'b972be0e-a5e7-4bdc-97f8-6dcd41ded21a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:07 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:07 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Acquiring lock "cinder-137eb764-50d1-4a7d-900e-f71a5a31f331-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Lock "cinder-137eb764-50d1-4a7d-900e-f71a5a31f331-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Acquiring lock "cinder-quobyte-137eb764-50d1-4a7d-900e-f71a5a31f331" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Lock "cinder-quobyte-137eb764-50d1-4a7d-900e-f71a5a31f331" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33779cc-fd70-4909-9e29-7a9701545a6e]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Acquiring lock "cinder-9a43e4af-b8d2-485b-899c-b936d63851e3-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:08 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331 Jun 03 14:44:08 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Lock "cinder-9a43e4af-b8d2-485b-899c-b936d63851e3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:08 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Acquiring lock "cinder-quobyte-9a43e4af-b8d2-485b-899c-b936d63851e3" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.727s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Lock "cinder-quobyte-9a43e4af-b8d2-485b-899c-b936d63851e3" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:08 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Deleted volume successfully. Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2759930a-0704-4964-9f4b-2445728c62cd tempest-VolumesTestJSON-377607662 None] Lock "cinder-95037aeb-865e-4dca-a0b3-1817efb745ba-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bec942-2e52-4bd4-a7f4-f15f17e253b9]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:44:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:08 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3 Jun 03 14:44:08 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:09 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331" returned: 0 in 1.287s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:09 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331 Jun 03 14:44:09 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:09 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3" returned: 0 in 1.382s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:10 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3 Jun 03 14:44:10 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:10 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-137eb764-50d1-4a7d-900e-f71a5a31f331" returned: 0 in 1.083s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Lock "cinder-quobyte-137eb764-50d1-4a7d-900e-f71a5a31f331" released by "delete_volume" :: held 2.439s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:10 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Created reservations ['20535d6f-04ae-4be3-9f44-1db743e7e2c5', 'd5857102-dcf7-4dbe-98a5-4ebcadad44cb', 'e20b0411-92cb-4b19-94e3-8eee43b4bb54', '2537bb31-9db8-4b8f-9524-0b218c6813ec'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:44:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:10 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:10 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:11 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a43e4af-b8d2-485b-899c-b936d63851e3" returned: 0 in 1.067s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Lock "cinder-quobyte-9a43e4af-b8d2-485b-899c-b936d63851e3" released by "delete_volume" :: held 2.514s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Created reservations ['0b54da74-0a4f-49d9-b617-46275e5124ad', '53b3e0fc-83e0-4e1f-915a-aec61de09129', '43a9b4a4-7f7f-4850-b04a-ad0bfb544775', 'c9a41fa3-9874-4a72-9cdd-4f1c2683122b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:11 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:11 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:11 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.789s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:11 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Deleted volume successfully. Jun 03 14:44:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-216e17d6-d018-4408-9cfc-42a8ca82daf0 tempest-VolumesTransfersV357Test-858039045 None] Lock "cinder-137eb764-50d1-4a7d-900e-f71a5a31f331-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:12 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.104s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:12 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:12 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Deleted volume successfully. Jun 03 14:44:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1aca5c73-90cd-4dc9-8b64-633c9b0f7f4f tempest-VolumesTestJSON-377607662 None] Lock "cinder-9a43e4af-b8d2-485b-899c-b936d63851e3-delete_volume" released by "delete_volume" :: held 3.918s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:21 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=77,cinder:INSERT=25,cinder:UPDATE=100,cinder:DELETE=11 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:44:22 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=93,cinder:SELECT=65,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Flow 'volume_create_manager' (dfeeac87-7f7a-433d-9be3-747b9206ff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011f3c21-64b7-4fe6-8d0c-2be3d2fb666b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011f3c21-64b7-4fe6-8d0c-2be3d2fb666b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2054596117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f515d9-2098-45ea-a8d1-754275efa38d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69f2f06081984994bbbe1af80f87e50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:23Z,use_quota=True,user_id='a46c49888f73462ea3e8ad3607b06db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c2aafd-cbe7-40ba-b4e7-742d619a3e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c2aafd-cbe7-40ba-b4e7-742d619a3e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e2c049-4d8d-43f6-9078-106cfc9ce287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e2c049-4d8d-43f6-9078-106cfc9ce287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f515d9-2098-45ea-a8d1-754275efa38d', 'volume_name': 'volume-28f515d9-2098-45ea-a8d1-754275efa38d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02d6c42-86a3-4481-877e-b779ede54d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02d6c42-86a3-4481-877e-b779ede54d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f64096-9302-4203-9e60-33c63761ae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:23 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Volume 28f515d9-2098-45ea-a8d1-754275efa38d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f515d9-2098-45ea-a8d1-754275efa38d', 'volume_size': 1} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2054596117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f515d9-2098-45ea-a8d1-754275efa38d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69f2f06081984994bbbe1af80f87e50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:23Z,use_quota=True,user_id='a46c49888f73462ea3e8ad3607b06db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Creating volume 28f515d9-2098-45ea-a8d1-754275efa38d {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:44:23 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:44:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:23 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d 1073741824 Jun 03 14:44:23 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:24 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d 1073741824" returned: 0 in 0.828s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:24 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d Jun 03 14:44:24 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:24 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d" returned: 0 in 0.616s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:44:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f64096-9302-4203-9e60-33c63761ae54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f515d9-2098-45ea-a8d1-754275efa38d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c8c4fe-7bab-4e81-9696-22223e4ce838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:24 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Volume volume-28f515d9-2098-45ea-a8d1-754275efa38d (28f515d9-2098-45ea-a8d1-754275efa38d): created successfully Jun 03 14:44:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c8c4fe-7bab-4e81-9696-22223e4ce838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Flow 'volume_create_manager' (dfeeac87-7f7a-433d-9be3-747b9206ff2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:24 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-41f7738a-62ea-46af-9295-e4b06c73a26c tempest-VolumesListTestJSON-1889851653 None] Created volume successfully. Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Flow 'volume_create_manager' (215c988e-7129-410c-9885-6a887b19579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72260b14-41fe-4da7-ab0f-8524944f9a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72260b14-41fe-4da7-ab0f-8524944f9a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-359361534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ac27b0-568e-497d-8384-4225778becf0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69f2f06081984994bbbe1af80f87e50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:26Z,use_quota=True,user_id='a46c49888f73462ea3e8ad3607b06db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3ba012-072e-4bdb-9841-a05452a155e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3ba012-072e-4bdb-9841-a05452a155e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85817576-a75b-4b2e-acc5-29e4bfa59ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85817576-a75b-4b2e-acc5-29e4bfa59ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ac27b0-568e-497d-8384-4225778becf0', 'volume_name': 'volume-48ac27b0-568e-497d-8384-4225778becf0', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd1b2f4-bfc9-457e-95b8-6513ef0a66ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd1b2f4-bfc9-457e-95b8-6513ef0a66ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c621e99-5b19-4098-813e-61560143cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:25 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Volume 48ac27b0-568e-497d-8384-4225778becf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ac27b0-568e-497d-8384-4225778becf0', 'volume_size': 1} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-359361534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ac27b0-568e-497d-8384-4225778becf0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69f2f06081984994bbbe1af80f87e50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:26Z,use_quota=True,user_id='a46c49888f73462ea3e8ad3607b06db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Creating volume 48ac27b0-568e-497d-8384-4225778becf0 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:44:25 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:44:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:25 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0 1073741824 Jun 03 14:44:25 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:27 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0 1073741824" returned: 0 in 1.211s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:27 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0 Jun 03 14:44:27 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:27 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0" returned: 0 in 0.677s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:44:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c621e99-5b19-4098-813e-61560143cd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ac27b0-568e-497d-8384-4225778becf0', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea026ed-aace-4f05-8bf1-4a4dbc7ee4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:27 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Volume volume-48ac27b0-568e-497d-8384-4225778becf0 (48ac27b0-568e-497d-8384-4225778becf0): created successfully Jun 03 14:44:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea026ed-aace-4f05-8bf1-4a4dbc7ee4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Flow 'volume_create_manager' (215c988e-7129-410c-9885-6a887b19579c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:28 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-adb3e05e-2d41-4129-a508-26430fae2941 tempest-VolumesListTestJSON-1889851653 None] Created volume successfully. Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Flow 'volume_create_manager' (7a8ed21d-4236-4457-8db1-6aebf9875f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0daf19-ec93-49a4-bfc6-db122fd8891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0daf19-ec93-49a4-bfc6-db122fd8891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-571405814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69f2f06081984994bbbe1af80f87e50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:30Z,use_quota=True,user_id='a46c49888f73462ea3e8ad3607b06db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d3ef5e-843a-4df4-a068-2e90fcd746ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d3ef5e-843a-4df4-a068-2e90fcd746ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b13502-7fd6-4b6f-b50a-fecaba60e595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b13502-7fd6-4b6f-b50a-fecaba60e595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c', 'volume_name': 'volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7a2969-5863-4fe4-a22f-67b9b1c73b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7a2969-5863-4fe4-a22f-67b9b1c73b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9541e03-fc38-421d-83d9-36aed4835c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:29 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Volume 3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c', 'volume_size': 1} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-571405814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69f2f06081984994bbbe1af80f87e50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:30Z,use_quota=True,user_id='a46c49888f73462ea3e8ad3607b06db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Creating volume 3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:44:29 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:44:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:29 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c 1073741824 Jun 03 14:44:29 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:31 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c 1073741824" returned: 0 in 1.312s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:31 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c Jun 03 14:44:31 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:32 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c" returned: 0 in 0.967s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] <== create_volume: return (2335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:44:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.340s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9541e03-fc38-421d-83d9-36aed4835c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2b2ba3-38ab-4993-b009-b8d197b71f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:32 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Volume volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c (3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c): created successfully Jun 03 14:44:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2b2ba3-38ab-4993-b009-b8d197b71f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Flow 'volume_create_manager' (7a8ed21d-4236-4457-8db1-6aebf9875f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:32 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-946315c0-dfce-46d3-9a0b-5297a37379e1 tempest-VolumesListTestJSON-1889851653 None] Created volume successfully. Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Flow 'volume_create_manager' (9bafca25-d217-4a6f-a8c5-c4cf85ec2529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c9b5a1-ccd3-4ee1-b9ba-8a141170d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c9b5a1-ccd3-4ee1-b9ba-8a141170d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1099785128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f983f0b7-8990-4258-986c-60a8061767f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b78e46dc4984f4c89507440ecbf9fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:35Z,use_quota=True,user_id='f0fcd9018feb4c2394b49fa349b96116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff27da8-1d8b-48cc-b2e0-0ffed19dfaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff27da8-1d8b-48cc-b2e0-0ffed19dfaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71dc448-9faf-45f5-92d7-6fac8069fab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71dc448-9faf-45f5-92d7-6fac8069fab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f983f0b7-8990-4258-986c-60a8061767f8', 'volume_name': 'volume-f983f0b7-8990-4258-986c-60a8061767f8', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad660702-eda9-4e78-8ed8-16dcf09258a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad660702-eda9-4e78-8ed8-16dcf09258a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0afefbf-dac3-4495-9af2-064fb45fffcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:35 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Volume f983f0b7-8990-4258-986c-60a8061767f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f983f0b7-8990-4258-986c-60a8061767f8', 'volume_size': 1} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1099785128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f983f0b7-8990-4258-986c-60a8061767f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b78e46dc4984f4c89507440ecbf9fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:35Z,use_quota=True,user_id='f0fcd9018feb4c2394b49fa349b96116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Creating volume f983f0b7-8990-4258-986c-60a8061767f8 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:44:35 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:44:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:35 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 1073741824 Jun 03 14:44:35 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "cinder-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "cinder-quobyte-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-quobyte-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c" acquired by "delete_volume" :: waited 0.044s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1640c08-4117-47a6-9ed6-341ee83df100]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:44:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:36 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c Jun 03 14:44:36 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:36 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 1073741824" returned: 0 in 1.516s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:37 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 Jun 03 14:44:37 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:37 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c" returned: 0 in 1.364s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:38 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c Jun 03 14:44:38 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:38 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8" returned: 0 in 1.072s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] <== create_volume: return (2660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:44:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.663s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0afefbf-dac3-4495-9af2-064fb45fffcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f983f0b7-8990-4258-986c-60a8061767f8', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c571729-250c-4ce7-aea6-6c1382058655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:38 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Volume volume-f983f0b7-8990-4258-986c-60a8061767f8 (f983f0b7-8990-4258-986c-60a8061767f8): created successfully Jun 03 14:44:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c571729-250c-4ce7-aea6-6c1382058655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Flow 'volume_create_manager' (9bafca25-d217-4a6f-a8c5-c4cf85ec2529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:38 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5de7c21c-63e4-4b1f-b496-b0196e83a7cc tempest-ServerActionsTestOtherA-1711625355 None] Created volume successfully. Jun 03 14:44:38 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c" returned: 0 in 0.977s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-quobyte-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c" released by "delete_volume" :: held 2.426s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Created reservations ['46d2de04-77f9-47fd-bc39-87e897fa24cf', '16dab44a-eceb-4da8-a0c4-cb97b5108c60', '8ad8e52b-ab75-4099-8051-c1cb5ee4655d', '5c6de5f4-1808-4821-8882-567d7284b04d'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:39 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:39 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Flow 'volume_create_manager' (a68eb812-d1e7-43b6-8b38-d0a9e91d6096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f89a94d-d990-45f4-b8d5-77dd37192bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f89a94d-d990-45f4-b8d5-77dd37192bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-69543765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186b0588fe9f466a8afd6e65015292c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:39Z,use_quota=True,user_id='1eda40c998d948cb9c7ea5ee48cd4a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a380f4ad-188c-4704-9662-4d22084458a9),volume_type_id=a380f4ad-188c-4704-9662-4d22084458a9)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1a7fed-1c9e-4a86-892e-c09c3ddebc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1a7fed-1c9e-4a86-892e-c09c3ddebc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68b4cf4-5d04-4903-a882-22d486f304d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68b4cf4-5d04-4903-a882-22d486f304d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05', 'volume_name': 'volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83827760-9c13-4be6-9f62-0149e658c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83827760-9c13-4be6-9f62-0149e658c440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70adde95-eb47-4c6a-bbea-02d9286986a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:39 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Volume 8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05', 'volume_size': 1} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-69543765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186b0588fe9f466a8afd6e65015292c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:39Z,use_quota=True,user_id='1eda40c998d948cb9c7ea5ee48cd4a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a380f4ad-188c-4704-9662-4d22084458a9),volume_type_id=a380f4ad-188c-4704-9662-4d22084458a9)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Creating volume 8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:44:39 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:44:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:39 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 1073741824 Jun 03 14:44:39 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "cinder-48ac27b0-568e-497d-8384-4225778becf0-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-48ac27b0-568e-497d-8384-4225778becf0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "cinder-quobyte-48ac27b0-568e-497d-8384-4225778becf0" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-quobyte-48ac27b0-568e-497d-8384-4225778becf0" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:40 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.156s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:40 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Deleted volume successfully. Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25338cd-39de-42e8-8697-810ee27d792b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-264d07aa-f4ac-4842-89cb-1d1de4bfe617 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-3e81b76e-7f0e-41e8-b0f5-9d593fbdc17c-delete_volume" released by "delete_volume" :: held 3.934s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:40 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0 Jun 03 14:44:40 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:40 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 1073741824" returned: 0 in 1.049s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:40 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 Jun 03 14:44:40 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:41 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0" returned: 0 in 0.738s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:41 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0 Jun 03 14:44:41 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:41 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05" returned: 0 in 0.623s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70adde95-eb47-4c6a-bbea-02d9286986a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a34304-7b2d-4774-88d2-f2a59d9c58db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:41 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Volume volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 (8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05): created successfully Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a34304-7b2d-4774-88d2-f2a59d9c58db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Flow 'volume_create_manager' (a68eb812-d1e7-43b6-8b38-d0a9e91d6096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:41 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-aaa8470e-b627-42e3-85ce-e9531fc9492d tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Created volume successfully. Jun 03 14:44:41 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48ac27b0-568e-497d-8384-4225778becf0" returned: 0 in 0.619s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-quobyte-48ac27b0-568e-497d-8384-4225778becf0" released by "delete_volume" :: held 1.428s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Created reservations ['4082f7e2-a3f7-48e0-9333-d9057c363a80', 'cd61181c-19fa-40e2-b1a1-9e39b42be817', '7a6ff939-4551-44cd-8453-422155a264fb', '2567bcb5-e3fb-4e67-a175-dc30800bce9b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:41 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:41 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a3b3a8bf-f0f4-4fcf-bb97-2886c4e743a2 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a3b3a8bf-f0f4-4fcf-bb97-2886c4e743a2 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a3b3a8bf-f0f4-4fcf-bb97-2886c4e743a2 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a3b3a8bf-f0f4-4fcf-bb97-2886c4e743a2 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a3b3a8bf-f0f4-4fcf-bb97-2886c4e743a2 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a3b3a8bf-f0f4-4fcf-bb97-2886c4e743a2 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:42 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:42 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "cinder-28f515d9-2098-45ea-a8d1-754275efa38d-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:42 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.637s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:42 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Deleted volume successfully. Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-28f515d9-2098-45ea-a8d1-754275efa38d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8dd28659-a5a3-48b4-b885-0de93ac228d7 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-48ac27b0-568e-497d-8384-4225778becf0-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "cinder-quobyte-28f515d9-2098-45ea-a8d1-754275efa38d" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-quobyte-28f515d9-2098-45ea-a8d1-754275efa38d" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[077220ad-9686-4ffd-b1cb-d95137ca2b03]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:42 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a3b3a8bf-f0f4-4fcf-bb97-2886c4e743a2 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.652s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:42 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-a3b3a8bf-f0f4-4fcf-bb97-2886c4e743a2 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:42 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a3b3a8bf-f0f4-4fcf-bb97-2886c4e743a2 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Retype volume completed successfully. Jun 03 14:44:42 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d Jun 03 14:44:42 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Acquiring lock "cinder-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "cinder-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Acquiring lock "cinder-quobyte-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:44:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "cinder-quobyte-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:44:43 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d" returned: 0 in 0.731s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:43 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb62f954-41ad-47b6-9330-01c40e3a32d2]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:44:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:43 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d Jun 03 14:44:43 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:43 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 Jun 03 14:44:43 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:43 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-28f515d9-2098-45ea-a8d1-754275efa38d" returned: 0 in 0.616s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-quobyte-28f515d9-2098-45ea-a8d1-754275efa38d" released by "delete_volume" :: held 1.405s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Created reservations ['6bd8e0d8-bc72-4873-94ee-b826600d7a48', '03d620bc-3406-4e1c-9e91-89fbe7c197f1', '57e0687b-af18-4478-b510-d217641af4fb', '125fc5e4-fa66-471e-a4a7-f8256dc63303'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:44:44 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05" returned: 0 in 0.762s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:44 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:44 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:44 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05 Jun 03 14:44:44 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:44 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.599s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Deleted volume successfully. Jun 03 14:44:44 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05" returned: 0 in 0.608s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "cinder-quobyte-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05" released by "delete_volume" :: held 1.423s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0c7c7526-6665-494d-8fda-586cd39760a3 tempest-VolumesListTestJSON-1889851653 None] Lock "cinder-28f515d9-2098-45ea-a8d1-754275efa38d-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:44 devstack cinder-volume[86614]: WARNING cinder.quota [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:44:44 devstack cinder-volume[86614]: WARNING cinder.quota [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Created reservations ['bca29fa3-f1fb-4de8-9612-1c6299026150', '0f911e46-f025-4b53-8b0f-bd505a15f8a9', '31f2e99c-99e1-41c6-a36d-d923bce72159', 'b6e42f06-4eea-4fef-8bdb-9b1a9b68e487'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:44 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:44 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:45 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.637s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:45 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:45 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Deleted volume successfully. Jun 03 14:44:45 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04d41d00-cf96-49ab-9b52-d5fd4b045275 tempest-VolumeRetypeWithoutMigrationTest-1431939072 None] Lock "cinder-8ceabe5b-8e70-4c80-9d8a-747f0b7b3e05-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:44:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:44:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:53 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:44:53 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:54 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.827s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:44:54 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=44,cinder:SELECT=41,cinder:DELETE=5,cinder:INSERT=11 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:44:55 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=34,cinder:INSERT=10,cinder:UPDATE=60,cinder:DELETE=4 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Flow 'volume_create_manager' (ef2528a2-f0c8-4ed8-8416-4f4219dee5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3889156-bc62-491d-b17b-913949c200bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3889156-bc62-491d-b17b-913949c200bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562634558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c2bb5e-7ce5-452a-b123-3bcf63e49045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a45dbf9aa94c6c957be78a9d8c50d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:58Z,use_quota=True,user_id='5d6257d7e44e42ed885ec3781728ec4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbcfbe38-f759-400a-ac3a-130dd91d946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbcfbe38-f759-400a-ac3a-130dd91d946a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bb74a4-11fe-4797-9951-b9b69d45d0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bb74a4-11fe-4797-9951-b9b69d45d0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c2bb5e-7ce5-452a-b123-3bcf63e49045', 'volume_name': 'volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd55b6a-860d-4a6f-b0b7-efc7fada82fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd55b6a-860d-4a6f-b0b7-efc7fada82fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec398e4e-f5e1-4d02-a733-0e24fdf4ac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:44:58 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Volume d2c2bb5e-7ce5-452a-b123-3bcf63e49045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045', 'volume_size': 1} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562634558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c2bb5e-7ce5-452a-b123-3bcf63e49045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a45dbf9aa94c6c957be78a9d8c50d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:44:58Z,use_quota=True,user_id='5d6257d7e44e42ed885ec3781728ec4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Creating volume d2c2bb5e-7ce5-452a-b123-3bcf63e49045 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:44:58 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:44:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:58 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 1073741824 Jun 03 14:44:58 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:44:59 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Jun 03 14:44:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 1073741824" returned: 0 in 1.159s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:44:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:44:59 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 Jun 03 14:44:59 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:00 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" returned: 0 in 0.844s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:45:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec398e4e-f5e1-4d02-a733-0e24fdf4ac12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be8051b-4de0-4bc6-a9bc-4990ee7ba64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:00 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Volume volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 (d2c2bb5e-7ce5-452a-b123-3bcf63e49045): created successfully Jun 03 14:45:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be8051b-4de0-4bc6-a9bc-4990ee7ba64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Flow 'volume_create_manager' (ef2528a2-f0c8-4ed8-8416-4f4219dee5f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:00 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-12371aa4-2b3e-4081-80f1-71f07bb4652d tempest-VolumesSnapshotTestJSON-297675284 None] Created volume successfully. Jun 03 14:45:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Creating offline snapshot 882b26b3-33cf-43d7-8a56-a681f820fb2e of volume d2c2bb5e-7ce5-452a-b123-3bcf63e49045 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:45:01 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2cec3f-2917-4f9f-a4dd-1dd45e97e320]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:02 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 Jun 03 14:45:02 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:03 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" returned: 0 in 1.043s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:03 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e 1G Jun 03 14:45:03 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:03 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e 1G" returned: 0 in 0.891s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:03 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e Jun 03 14:45:03 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:04 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-3fcd6eed-69c1-474b-8329-adb9d243de45 req-4bad6598-5ea4-4d2a-bb64-5fa9c882529a tempest-AttachVolumeNegativeTest-1795286255 None] Terminate volume connection completed successfully. Jun 03 14:45:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-3fcd6eed-69c1-474b-8329-adb9d243de45 req-4bad6598-5ea4-4d2a-bb64-5fa9c882529a tempest-AttachVolumeNegativeTest-1795286255 None] Deleting attachment 403a2e48-ed51-4ef6-8e03-09ab7847b7ff. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:45:04 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e" returned: 0 in 0.946s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:04 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e is being set with open permissions: ugo+rw Jun 03 14:45:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:04 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e Jun 03 14:45:04 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:05 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e" returned: 0 in 0.648s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:05 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.info Jun 03 14:45:05 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:06 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.info" returned: 0 in 0.819s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:06 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.info is being set with open permissions: ugo+rw Jun 03 14:45:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:06 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.info Jun 03 14:45:06 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:07 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.info" returned: 0 in 0.858s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.332s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:07 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c83431c9-aae1-436a-938d-d1dc0f38d4fd tempest-VolumesSnapshotTestJSON-297675284 None] Create snapshot completed successfully Jun 03 14:45:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-882b26b3-33cf-43d7-8a56-a681f820fb2e-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-882b26b3-33cf-43d7-8a56-a681f820fb2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-882b26b3-33cf-43d7-8a56-a681f820fb2e" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-882b26b3-33cf-43d7-8a56-a681f820fb2e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Deleting offline snapshot 882b26b3-33cf-43d7-8a56-a681f820fb2e of volume d2c2bb5e-7ce5-452a-b123-3bcf63e49045 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:45:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] snapshot_file for this snap is: volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:45:08 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[3118a17c-2c39-4551-a51e-931d1efeb69e]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:08 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e Jun 03 14:45:08 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:09 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e" returned: 0 in 1.073s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:45:09 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c398c3-a43a-4a90-b0fb-ea61d862b091]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:09 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 Jun 03 14:45:09 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Flow 'volume_create_manager' (b76781e1-0f7b-4be4-8454-03e6aaae0027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782ecb91-9bbd-40a6-b1da-bc3600853532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782ecb91-9bbd-40a6-b1da-bc3600853532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1044445333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c412b3b-b263-4987-9aeb-ef8a3893c94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692880c19cb49eba96339931a601e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:10Z,use_quota=True,user_id='b6c418e39a104f60b08b2136a7a3b19a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9f1ff6-abc1-449b-8cd6-377bee03351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9f1ff6-abc1-449b-8cd6-377bee03351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341d08aa-f139-4ed2-8240-b8391397b5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341d08aa-f139-4ed2-8240-b8391397b5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c412b3b-b263-4987-9aeb-ef8a3893c94f', 'volume_name': 'volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9d9533-54df-42aa-b402-76ff0422305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9d9533-54df-42aa-b402-76ff0422305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b064da13-2b57-4fb8-a684-d6f05b0d1dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:10 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Volume 7c412b3b-b263-4987-9aeb-ef8a3893c94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f', 'volume_size': 1} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1044445333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c412b3b-b263-4987-9aeb-ef8a3893c94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692880c19cb49eba96339931a601e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:10Z,use_quota=True,user_id='b6c418e39a104f60b08b2136a7a3b19a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Creating volume 7c412b3b-b263-4987-9aeb-ef8a3893c94f {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:45:10 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:10 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f 1073741824 Jun 03 14:45:10 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:10 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" returned: 0 in 0.727s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:10 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e Jun 03 14:45:10 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:11 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f 1073741824" returned: 0 in 0.878s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:11 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f Jun 03 14:45:11 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:11 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e" returned: 0 in 0.725s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:11 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e Jun 03 14:45:11 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:11 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f" returned: 0 in 0.626s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b064da13-2b57-4fb8-a684-d6f05b0d1dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f148c7b1-8f9f-4c02-8c1b-818c5487b3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:11 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Volume volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f (7c412b3b-b263-4987-9aeb-ef8a3893c94f): created successfully Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f148c7b1-8f9f-4c02-8c1b-818c5487b3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Flow 'volume_create_manager' (b76781e1-0f7b-4be4-8454-03e6aaae0027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:11 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-94c79c8c-b306-410a-927f-356fcec04f54 tempest-VolumesListAdminTestJSON-1011009735 None] Created volume successfully. Jun 03 14:45:11 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045.882b26b3-33cf-43d7-8a56-a681f820fb2e" returned: 0 in 0.591s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-882b26b3-33cf-43d7-8a56-a681f820fb2e" released by "_delete_snapshot" :: held 3.257s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" released by "delete_snapshot" :: held 3.284s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:11 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Created reservations ['04cfb7ee-ac0e-4103-9793-5414d66b8592', 'fe544efb-3e9a-4c64-baa5-6f5c4076fcce', 'b75ae133-0ad8-44c6-a4bd-8108fe638266', '9129b6e9-bf05-42f7-a183-dfe019410923'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:45:12 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Delete snapshot completed successfully. Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-547c05df-ab6c-4c70-8aab-7e0b780f1a7f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-882b26b3-33cf-43d7-8a56-a681f820fb2e-delete_snapshot" released by "delete_snapshot" :: held 3.468s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Flow 'volume_create_manager' (0386d44b-2773-45b2-bd24-5dbf842d2824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ba116f-a26d-4891-8a10-5df04900382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ba116f-a26d-4891-8a10-5df04900382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-509733160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4488fa87-9deb-41a9-abb2-c7d9836b3372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692880c19cb49eba96339931a601e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:13Z,use_quota=True,user_id='b6c418e39a104f60b08b2136a7a3b19a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20ec9a6-5430-42cf-bbc2-d287952ec998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20ec9a6-5430-42cf-bbc2-d287952ec998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae8319d-a906-4dd6-8919-0868d2511bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae8319d-a906-4dd6-8919-0868d2511bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4488fa87-9deb-41a9-abb2-c7d9836b3372', 'volume_name': 'volume-4488fa87-9deb-41a9-abb2-c7d9836b3372', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8deb955-2ee0-4ae1-8604-b516cc6c4e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8deb955-2ee0-4ae1-8604-b516cc6c4e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70839e3-dc99-4a71-af01-d3d489bdb381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:12 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Volume 4488fa87-9deb-41a9-abb2-c7d9836b3372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4488fa87-9deb-41a9-abb2-c7d9836b3372', 'volume_size': 1} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-509733160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4488fa87-9deb-41a9-abb2-c7d9836b3372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692880c19cb49eba96339931a601e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:13Z,use_quota=True,user_id='b6c418e39a104f60b08b2136a7a3b19a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Creating volume 4488fa87-9deb-41a9-abb2-c7d9836b3372 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:45:12 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:45:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:12 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372 1073741824 Jun 03 14:45:12 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Flow 'volume_create_manager' (75f0b658-5cfd-4329-8754-d0df1a625f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563c05c3-57b7-4255-91c0-628e176f6410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563c05c3-57b7-4255-91c0-628e176f6410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-805228780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996afef0-534b-4382-8886-d2c454112d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a45dbf9aa94c6c957be78a9d8c50d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:13Z,use_quota=True,user_id='5d6257d7e44e42ed885ec3781728ec4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebebc76-2d9e-4f82-9ecb-ed72a5b2784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebebc76-2d9e-4f82-9ecb-ed72a5b2784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cd3d62-0c8d-42d8-bf3e-eb294db46567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cd3d62-0c8d-42d8-bf3e-eb294db46567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '996afef0-534b-4382-8886-d2c454112d7d', 'volume_name': 'volume-996afef0-534b-4382-8886-d2c454112d7d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5be849-73b1-4f44-b640-4ff39c4ea66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5be849-73b1-4f44-b640-4ff39c4ea66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2954724c-e5f8-4fbf-b415-70c328a83607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:13 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Volume 996afef0-534b-4382-8886-d2c454112d7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-996afef0-534b-4382-8886-d2c454112d7d', 'volume_size': 1} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:13 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372 1073741824" returned: 0 in 0.904s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:13 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372 Jun 03 14:45:13 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:14 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372" returned: 0 in 0.609s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-805228780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996afef0-534b-4382-8886-d2c454112d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a45dbf9aa94c6c957be78a9d8c50d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:13Z,use_quota=True,user_id='5d6257d7e44e42ed885ec3781728ec4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Creating volume 996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:45:14 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70839e3-dc99-4a71-af01-d3d489bdb381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4488fa87-9deb-41a9-abb2-c7d9836b3372', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e517f83e-2e13-4606-8cdc-98dd2715e992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:14 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d 1073741824 Jun 03 14:45:14 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:14 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Volume volume-4488fa87-9deb-41a9-abb2-c7d9836b3372 (4488fa87-9deb-41a9-abb2-c7d9836b3372): created successfully Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e517f83e-2e13-4606-8cdc-98dd2715e992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Flow 'volume_create_manager' (0386d44b-2773-45b2-bd24-5dbf842d2824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:14 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-15af92b1-a93a-4600-a602-1f8a561b61ed tempest-VolumesListAdminTestJSON-1011009735 None] Created volume successfully. Jun 03 14:45:15 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d 1073741824" returned: 0 in 0.991s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:15 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d Jun 03 14:45:15 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Flow 'volume_create_manager' (5794016d-652e-4268-986d-a28385813742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71eaac57-9bff-4898-bda7-a65be1c075ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71eaac57-9bff-4898-bda7-a65be1c075ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1638474217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692880c19cb49eba96339931a601e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:15Z,use_quota=True,user_id='b6c418e39a104f60b08b2136a7a3b19a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342604ce-5c8e-4895-a20e-0466d9a79668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342604ce-5c8e-4895-a20e-0466d9a79668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8a5fad-561b-4277-957b-e0e2ebfac41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8a5fad-561b-4277-957b-e0e2ebfac41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85', 'volume_name': 'volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d985f5fe-d7dd-4ae7-9cea-824f481abc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d985f5fe-d7dd-4ae7-9cea-824f481abc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71516923-6019-4a44-960f-33b165bf8591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:15 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Volume 14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85', 'volume_size': 1} Jun 03 14:45:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:15 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d" returned: 0 in 0.684s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1638474217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692880c19cb49eba96339931a601e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:15Z,use_quota=True,user_id='b6c418e39a104f60b08b2136a7a3b19a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Creating volume 14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:45:16 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:16 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 1073741824 Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2954724c-e5f8-4fbf-b415-70c328a83607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-996afef0-534b-4382-8886-d2c454112d7d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:16 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747b4866-fc7c-41a3-b47c-b04e9521b67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:16 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Volume volume-996afef0-534b-4382-8886-d2c454112d7d (996afef0-534b-4382-8886-d2c454112d7d): created successfully Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747b4866-fc7c-41a3-b47c-b04e9521b67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Flow 'volume_create_manager' (75f0b658-5cfd-4329-8754-d0df1a625f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:16 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5b4a38ef-a0ed-41b1-8b75-94e226f8083f tempest-VolumesSnapshotTestJSON-297675284 None] Created volume successfully. Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:16 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 1073741824" returned: 0 in 0.945s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:17 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 Jun 03 14:45:17 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:17 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85" returned: 0 in 0.623s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.774s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Creating offline snapshot d2b62ea2-b7dc-463e-bf36-c9db2316c75e of volume 996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71516923-6019-4a44-960f-33b165bf8591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ebd0a0-a102-4eec-b636-180b24b5fc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[49de379e-744e-41f1-b43f-5f3f5ba840f2]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:17 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Volume volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 (14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85): created successfully Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ebd0a0-a102-4eec-b636-180b24b5fc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Flow 'volume_create_manager' (5794016d-652e-4268-986d-a28385813742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:17 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b26505b1-f44b-4529-bb02-938ce412c152 tempest-VolumesListAdminTestJSON-1011009735 None] Created volume successfully. Jun 03 14:45:17 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d Jun 03 14:45:17 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:18 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d" returned: 0 in 0.722s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:18 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e 1G Jun 03 14:45:18 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:19 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e 1G" returned: 0 in 0.798s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-996afef0-534b-4382-8886-d2c454112d7d -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:45:19 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-996afef0-534b-4382-8886-d2c454112d7d -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e Jun 03 14:45:19 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Flow 'volume_create_manager' (53af8afb-ede6-4f9a-abec-4d0f6cb2619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5235f2a1-07c1-4ee2-a766-538e586ac471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5235f2a1-07c1-4ee2-a766-538e586ac471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a16c2b8-eed8-4b3f-9f58-d819b84ff54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a78c4257054edca54f2cc5e014f2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:19Z,use_quota=True,user_id='a5a2689420f44a77b48e167d72b2bc1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a4e688-e68a-41f4-97e3-85bec895d1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a4e688-e68a-41f4-97e3-85bec895d1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560ce086-a58d-4340-9647-7360162f5b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560ce086-a58d-4340-9647-7360162f5b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a16c2b8-eed8-4b3f-9f58-d819b84ff54c', 'volume_name': 'volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149b46db-5766-44c4-b70c-3f0e8c9a02b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149b46db-5766-44c4-b70c-3f0e8c9a02b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a81115d-67c3-4e40-ba0b-6afa4352f23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:19 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Volume 8a16c2b8-eed8-4b3f-9f58-d819b84ff54c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c', 'volume_size': 1} Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:19 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-996afef0-534b-4382-8886-d2c454112d7d -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e" returned: 0 in 0.647s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:19 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e is being set with open permissions: ugo+rw Jun 03 14:45:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:19 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e Jun 03 14:45:19 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:20 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e" returned: 0 in 0.604s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:20 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.info Jun 03 14:45:20 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:21 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.info" returned: 0 in 0.636s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:21 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.info is being set with open permissions: ugo+rw Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:21 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.info Jun 03 14:45:21 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:21 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.info" returned: 0 in 0.587s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.098s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.434s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a16c2b8-eed8-4b3f-9f58-d819b84ff54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a78c4257054edca54f2cc5e014f2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:19Z,use_quota=True,user_id='a5a2689420f44a77b48e167d72b2bc1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Creating volume 8a16c2b8-eed8-4b3f-9f58-d819b84ff54c {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:45:21 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:45:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:21 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c 1073741824 Jun 03 14:45:21 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-cd7e4adc-f7b6-432c-8029-8d5e4688aad7 tempest-VolumesSnapshotTestJSON-297675284 None] Create snapshot completed successfully Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Flow 'volume_create_manager' (5d40b100-aa03-4014-928e-b22dc490a74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c696aed5-ddfa-48e5-987d-df900d69e8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c696aed5-ddfa-48e5-987d-df900d69e8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-909073456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3877bb88-4998-4b5a-8d7b-939af1ba0c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a45dbf9aa94c6c957be78a9d8c50d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d2b62ea2-b7dc-463e-bf36-c9db2316c75e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:23Z,use_quota=True,user_id='5d6257d7e44e42ed885ec3781728ec4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:22 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8070500-941d-48cb-b012-e61298c881fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8070500-941d-48cb-b012-e61298c881fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0c6aad-63b1-48fb-83ec-cf62cb89de5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0c6aad-63b1-48fb-83ec-cf62cb89de5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3877bb88-4998-4b5a-8d7b-939af1ba0c2f', 'volume_name': 'volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f', 'volume_size': 2, 'snapshot_id': 'd2b62ea2-b7dc-463e-bf36-c9db2316c75e'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5522ed8-0299-4bab-a527-6621cd6155b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5522ed8-0299-4bab-a527-6621cd6155b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b55ea0b-45e3-4861-8ce0-d391619a6608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:22 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Volume 3877bb88-4998-4b5a-8d7b-939af1ba0c2f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f', 'volume_size': 2, 'snapshot_id': 'd2b62ea2-b7dc-463e-bf36-c9db2316c75e'} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c 1073741824" returned: 0 in 1.094s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:22 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c Jun 03 14:45:22 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:23 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c" returned: 0 in 0.685s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.730s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-d2b62ea2-b7dc-463e-bf36-c9db2316c75e-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" by "_create_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a81115d-67c3-4e40-ba0b-6afa4352f23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d6aece-7b4f-4111-944e-1a22068f71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d2b62ea2-b7dc-463e-bf36-c9db2316c75e-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Creating volume 3877bb88-4998-4b5a-8d7b-939af1ba0c2f from snapshot d2b62ea2-b7dc-463e-bf36-c9db2316c75e {{(pid=86614) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] snapshot: d2b62ea2-b7dc-463e-bf36-c9db2316c75e, volume: 3877bb88-4998-4b5a-8d7b-939af1ba0c2f, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 14:45:23 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Volume volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c (8a16c2b8-eed8-4b3f-9f58-d819b84ff54c): created successfully Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d6aece-7b4f-4111-944e-1a22068f71b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Flow 'volume_create_manager' (53af8afb-ede6-4f9a-abec-4d0f6cb2619c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:23 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-95e4f12f-dec6-48e2-a52e-083eec3d1573 tempest-VolumesListAdminTestJSON-764183087 None] Created volume successfully. Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4b27ae-7477-4ea9-8a77-3e262fc0ad53]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:23 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e Jun 03 14:45:23 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:24 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e" returned: 0 in 0.725s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-996afef0-534b-4382-8886-d2c454112d7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1867e129-6857-44fe-9ed8-fd77670820e4]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:24 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d Jun 03 14:45:24 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Acquiring lock "cinder-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Lock "cinder-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Acquiring lock "cinder-quobyte-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Lock "cinder-quobyte-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c" acquired by "delete_volume" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3581e2d-9bdc-49f3-a84b-67e5e77a5ee6]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "cinder-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:24 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c Jun 03 14:45:24 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "cinder-quobyte-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-quobyte-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b560c28-5803-451a-a659-3b9bad285451]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:25 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 Jun 03 14:45:25 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:25 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d" returned: 0 in 0.864s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:25 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 14:45:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:25 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f Jun 03 14:45:25 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:25 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c" returned: 0 in 0.778s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:25 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c Jun 03 14:45:25 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:25 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85" returned: 0 in 0.810s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:25 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85 Jun 03 14:45:25 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:26 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c" returned: 0 in 0.830s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Lock "cinder-quobyte-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c" released by "delete_volume" :: held 1.679s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:26 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Created reservations ['6cc604fb-8cda-4cb6-a772-4636cec8a760', 'e32cc177-acf5-4ea2-ba12-1ab92c182771', 'c5b38b70-653b-4643-aa19-c794f8fb7293', '9eea9670-462c-4193-a657-6ce5f7440b59'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:45:26 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85" returned: 0 in 0.956s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-quobyte-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85" released by "delete_volume" :: held 1.830s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Created reservations ['9a6ecb9d-f72d-49ee-a5e6-5a46403a263a', 'bab4da21-eb5d-47e7-977d-95a3b523a9ac', 'cd67bb90-a0ce-432c-b6ef-eaf728a99056', '4ef0c199-4253-4280-b5d7-eac617de004a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-d32d1673-080a-406e-8b66-ef75da8098d5 req-aed0d6c9-71e0-4e37-8a29-6c244de93496 tempest-ServerActionsTestOtherA-1711625355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:27 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:45:27 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:27 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:45:27 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:28 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.114s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:28 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:45:28 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Deleted volume successfully. Jun 03 14:45:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0f9e333-f3e3-4ccf-b74e-14fe128a032a tempest-VolumesListAdminTestJSON-764183087 None] Lock "cinder-8a16c2b8-eed8-4b3f-9f58-d819b84ff54c-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "cinder-4488fa87-9deb-41a9-abb2-c7d9836b3372-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-4488fa87-9deb-41a9-abb2-c7d9836b3372-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "cinder-quobyte-4488fa87-9deb-41a9-abb2-c7d9836b3372" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-quobyte-4488fa87-9deb-41a9-abb2-c7d9836b3372" acquired by "delete_volume" :: waited 0.059s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:29 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7e52fd-d781-4fe3-9a49-7f0012f4448c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:29 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.978s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:29 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:45:29 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372 Jun 03 14:45:29 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:29 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Deleted volume successfully. Jun 03 14:45:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9f6dce91-6ca6-47e8-b07f-e6237a0c2f42 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-14ab4a0e-1bd5-4a5f-ac2d-e367b3700e85-delete_volume" released by "delete_volume" :: held 5.240s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:32 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372" returned: 0 in 2.672s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:32 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372 Jun 03 14:45:32 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:33 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" returned: 0 in 7.828s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaa8105-bae7-4667-a6bd-65a92c65927d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:33 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d Jun 03 14:45:33 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:33 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4488fa87-9deb-41a9-abb2-c7d9836b3372" returned: 0 in 1.415s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-quobyte-4488fa87-9deb-41a9-abb2-c7d9836b3372" released by "delete_volume" :: held 4.231s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Created reservations ['e8e259d6-7c27-4e4c-b526-00da6900baec', '8a3cb78d-741f-464a-9dc5-1e3e243cc729', '44994264-323f-4d63-a9fb-36018869cadd', '1da9bf5a-e1cc-4f84-ae3c-d5f94c14d952'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:33 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:45:33 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "cinder-7c412b3b-b263-4987-9aeb-ef8a3893c94f-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-7c412b3b-b263-4987-9aeb-ef8a3893c94f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "cinder-quobyte-7c412b3b-b263-4987-9aeb-ef8a3893c94f" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-quobyte-7c412b3b-b263-4987-9aeb-ef8a3893c94f" acquired by "delete_volume" :: waited 0.046s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[185f649d-8d45-4154-aa03-744bb9ae12e8]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:34 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d" returned: 0 in 1.348s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d, size 1024.00 MB, duration 7.83 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:45:34 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Converted 1024.00 MB image at 130.79 MB/s Jun 03 14:45:34 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f is being set with open permissions: ugo+rw Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:34 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f Jun 03 14:45:34 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:34 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f Jun 03 14:45:34 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:34 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.060s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:45:34 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Deleted volume successfully. Jun 03 14:45:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1e1faad3-fa88-4155-bda6-97890d53e3f6 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-4488fa87-9deb-41a9-abb2-c7d9836b3372-delete_volume" released by "delete_volume" :: held 5.705s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:35 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" returned: 0 in 0.825s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" released by "_copy_volume_from_snapshot" :: held 11.746s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d2b62ea2-b7dc-463e-bf36-c9db2316c75e-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" released by "_create_volume_from_snapshot" :: held 11.808s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.852s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-d32d1673-080a-406e-8b66-ef75da8098d5 req-aed0d6c9-71e0-4e37-8a29-6c244de93496 tempest-ServerActionsTestOtherA-1711625355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.161s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69ff34e-e130-4539-8a20-7fc456458a0c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-d32d1673-080a-406e-8b66-ef75da8098d5 req-aed0d6c9-71e0-4e37-8a29-6c244de93496 tempest-ServerActionsTestOtherA-1711625355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b55ea0b-45e3-4861-8ce0-d391619a6608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f', 'volume_size': 2, 'snapshot_id': 'd2b62ea2-b7dc-463e-bf36-c9db2316c75e'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd186ed-7088-4aa7-bc16-904b48d0a82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:35 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Volume volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f (3877bb88-4998-4b5a-8d7b-939af1ba0c2f): created successfully Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd186ed-7088-4aa7-bc16-904b48d0a82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Flow 'volume_create_manager' (5d40b100-aa03-4014-928e-b22dc490a74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:35 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-815998fd-2ea3-4cb4-9d7b-c610cc16a1b8 tempest-VolumesSnapshotTestJSON-297675284 None] Created volume successfully. Jun 03 14:45:35 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f" returned: 0 in 1.163s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:35 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f Jun 03 14:45:35 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:35 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 Jun 03 14:45:35 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:36 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7c412b3b-b263-4987-9aeb-ef8a3893c94f" returned: 0 in 0.904s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-quobyte-7c412b3b-b263-4987-9aeb-ef8a3893c94f" released by "delete_volume" :: held 2.132s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-3877bb88-4998-4b5a-8d7b-939af1ba0c2f-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:36 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-d32d1673-080a-406e-8b66-ef75da8098d5 req-aed0d6c9-71e0-4e37-8a29-6c244de93496 tempest-ServerActionsTestOtherA-1711625355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8" returned: 0 in 1.128s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-d32d1673-080a-406e-8b66-ef75da8098d5 req-aed0d6c9-71e0-4e37-8a29-6c244de93496 tempest-ServerActionsTestOtherA-1711625355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.159s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-3877bb88-4998-4b5a-8d7b-939af1ba0c2f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Created reservations ['2cecbd37-029b-427d-aae6-eba48cca9a6b', '6ac096bc-411a-4963-8dfa-9ee522c8dd23', '5d67febd-dd13-48f4-b57b-76e4c94a5e50', '1d4824ab-4a34-4efb-a18a-520efe721ee2'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-d32d1673-080a-406e-8b66-ef75da8098d5 req-aed0d6c9-71e0-4e37-8a29-6c244de93496 tempest-ServerActionsTestOtherA-1711625355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-f983f0b7-8990-4258-986c-60a8061767f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc1019a1-b26e-483d-a4e9-1a7de0237edf', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" acquired by "delete_volume" :: waited 0.035s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ebf5d6-0ae1-4753-8902-20301af9bad7]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:36 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-d32d1673-080a-406e-8b66-ef75da8098d5 req-aed0d6c9-71e0-4e37-8a29-6c244de93496 tempest-ServerActionsTestOtherA-1711625355 None] attachment_update completed successfully. Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:36 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:45:36 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:36 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f Jun 03 14:45:36 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:37 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.818s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:37 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:45:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Deleted volume successfully. Jun 03 14:45:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f3b6a9a5-4fd9-4f66-b11c-edfe7257aac5 tempest-VolumesListAdminTestJSON-1011009735 None] Lock "cinder-7c412b3b-b263-4987-9aeb-ef8a3893c94f-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:37 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" returned: 0 in 0.969s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:37 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f Jun 03 14:45:37 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:38 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" returned: 0 in 0.771s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-3877bb88-4998-4b5a-8d7b-939af1ba0c2f" released by "delete_volume" :: held 1.803s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:38 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Created reservations ['919e18e3-53b2-488e-a2ac-bb7596d1d66b', '32651aa6-b065-4230-815d-08c85a8fc477', '36ebbdda-452a-4fa6-b066-07a7afe32e1a', '70620f94-8bfb-4878-8467-c6121d1458ce'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:45:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:38 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:45:38 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-d2b62ea2-b7dc-463e-bf36-c9db2316c75e-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-d2b62ea2-b7dc-463e-bf36-c9db2316c75e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-996afef0-534b-4382-8886-d2c454112d7d" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-996afef0-534b-4382-8886-d2c454112d7d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-d2b62ea2-b7dc-463e-bf36-c9db2316c75e" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d2b62ea2-b7dc-463e-bf36-c9db2316c75e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Deleting offline snapshot d2b62ea2-b7dc-463e-bf36-c9db2316c75e of volume 996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] snapshot_file for this snap is: volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede42431-6cd8-47e4-a8fb-6746e65fa510]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:39 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e Jun 03 14:45:39 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:39 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.872s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:45:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Deleted volume successfully. Jun 03 14:45:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8ae12bd5-f71c-4b4d-b383-5b1bb0dd41dd tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-3877bb88-4998-4b5a-8d7b-939af1ba0c2f-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:40 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e" returned: 0 in 0.918s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:40 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-996afef0-534b-4382-8886-d2c454112d7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:45:40 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[43525283-389d-47c6-b26e-13ac70256764]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:40 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d Jun 03 14:45:40 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:40 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d" returned: 0 in 0.775s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:40 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e Jun 03 14:45:40 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:41 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e" returned: 0 in 0.771s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:41 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e Jun 03 14:45:41 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:42 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d.d2b62ea2-b7dc-463e-bf36-c9db2316c75e" returned: 0 in 0.738s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d2b62ea2-b7dc-463e-bf36-c9db2316c75e" released by "_delete_snapshot" :: held 3.327s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-996afef0-534b-4382-8886-d2c454112d7d" released by "delete_snapshot" :: held 3.367s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:42 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Created reservations ['a6073828-3159-426c-b025-5ea2b9bc3278', '755c928d-e806-4d5b-8775-86ea364b4206', '7e6cab6b-e2b9-4d85-8a7e-d4e3f9a442de', 'b3407b84-20a3-414d-b041-76501ad00ad4'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:45:42 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Delete snapshot completed successfully. Jun 03 14:45:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-28da0ea5-9348-4482-9a95-2f73df743020 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-d2b62ea2-b7dc-463e-bf36-c9db2316c75e-delete_snapshot" released by "delete_snapshot" :: held 3.540s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-996afef0-534b-4382-8886-d2c454112d7d-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-996afef0-534b-4382-8886-d2c454112d7d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-996afef0-534b-4382-8886-d2c454112d7d" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:45:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-996afef0-534b-4382-8886-d2c454112d7d" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:45:43 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9432a9f-41e0-4f88-aaf3-d4d4883144a3]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:43 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d Jun 03 14:45:43 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:44 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d" returned: 0 in 0.832s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:44 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d Jun 03 14:45:44 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:45 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-996afef0-534b-4382-8886-d2c454112d7d" returned: 0 in 0.650s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-996afef0-534b-4382-8886-d2c454112d7d" released by "delete_volume" :: held 1.556s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Created reservations ['34a464b1-92e6-470b-8ee8-adbbe7686329', '308e2d0d-5352-4831-9a56-5a98b184450d', '77023d8a-aa55-4295-bd78-bdc1c3bf1c51', '5aeb47ec-d130-4363-8145-4dcf142a28d5'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:45 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:45:45 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Flow 'volume_create_manager' (7875e712-d400-43e3-8ffb-96bd36ee902c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beec6839-171d-4f88-879c-6c89f8d6514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beec6839-171d-4f88-879c-6c89f8d6514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1316821853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c61526f-6ac6-4a8d-9ccd-8393c3418300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64279d03c0b4fe3903900ed9e5904bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:46Z,use_quota=True,user_id='372ae4cef563468f82ddbbc86dd846c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4262f7-5f18-4cbd-a2d6-30d4bac21f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4262f7-5f18-4cbd-a2d6-30d4bac21f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a44079f-a097-416d-8a13-3a2303668e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a44079f-a097-416d-8a13-3a2303668e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c61526f-6ac6-4a8d-9ccd-8393c3418300', 'volume_name': 'volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c4acce-47f7-4230-a3ac-d164e4b34c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c4acce-47f7-4230-a3ac-d164e4b34c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6245ab6-147e-4b44-8f62-c05a26b77de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:45 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Volume 4c61526f-6ac6-4a8d-9ccd-8393c3418300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300', 'volume_size': 1} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1316821853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c61526f-6ac6-4a8d-9ccd-8393c3418300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64279d03c0b4fe3903900ed9e5904bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:46Z,use_quota=True,user_id='372ae4cef563468f82ddbbc86dd846c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Creating volume 4c61526f-6ac6-4a8d-9ccd-8393c3418300 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:45:45 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:45:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:45 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 1073741824 Jun 03 14:45:45 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:46 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-3d2df350-7380-4ae6-a42d-9b086e8d5c4d req-6e70fa99-e499-472d-b6dd-be3d295122bb tempest-ServerActionsTestOtherA-1711625355 None] Terminate volume connection completed successfully. Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-3d2df350-7380-4ae6-a42d-9b086e8d5c4d req-6e70fa99-e499-472d-b6dd-be3d295122bb tempest-ServerActionsTestOtherA-1711625355 None] Deleting attachment bc1019a1-b26e-483d-a4e9-1a7de0237edf. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:45:46 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.911s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:45:46 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Deleted volume successfully. Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bf94acc3-0825-4797-90af-abb469de0e7c tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-996afef0-534b-4382-8886-d2c454112d7d-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Flow 'volume_create_manager' (ec5f32cf-b22c-4a1e-9b5b-3c851e0d79b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9368775-a8e9-4115-b4c1-b83d485ba8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9368775-a8e9-4115-b4c1-b83d485ba8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-540208863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f3bb72-696f-4b92-93f2-96470fd1ce7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a45dbf9aa94c6c957be78a9d8c50d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:46Z,use_quota=True,user_id='5d6257d7e44e42ed885ec3781728ec4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4f30af-722a-4b6b-8680-88346501f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4f30af-722a-4b6b-8680-88346501f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733cb837-2970-4980-9ce2-0a932e3aa54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733cb837-2970-4980-9ce2-0a932e3aa54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f3bb72-696f-4b92-93f2-96470fd1ce7b', 'volume_name': 'volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac20f9df-8de9-45b9-9b48-cf479b2f697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac20f9df-8de9-45b9-9b48-cf479b2f697f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f062e221-07c2-47d8-b8fa-afc37750e324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:46 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Volume d8f3bb72-696f-4b92-93f2-96470fd1ce7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b', 'volume_size': 1} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:46 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 1073741824" returned: 0 in 1.031s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:46 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 Jun 03 14:45:46 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:47 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300" returned: 0 in 0.611s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.850s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-540208863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f3bb72-696f-4b92-93f2-96470fd1ce7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a45dbf9aa94c6c957be78a9d8c50d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:46Z,use_quota=True,user_id='5d6257d7e44e42ed885ec3781728ec4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Creating volume d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:45:47 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6245ab6-147e-4b44-8f62-c05a26b77de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:47 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b 1073741824 Jun 03 14:45:47 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db125d5-64e3-4dfd-a3d1-042593257c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:47 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Volume volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 (4c61526f-6ac6-4a8d-9ccd-8393c3418300): created successfully Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db125d5-64e3-4dfd-a3d1-042593257c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Flow 'volume_create_manager' (7875e712-d400-43e3-8ffb-96bd36ee902c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:47 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4281d650-c548-474c-81bf-25985bb28b47 tempest-VolumesDeleteCascade-419599363 None] Created volume successfully. Jun 03 14:45:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:48 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b 1073741824" returned: 0 in 0.781s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:48 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b Jun 03 14:45:48 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-3d2df350-7380-4ae6-a42d-9b086e8d5c4d req-99d660a8-e1d9-40e6-9c5e-bc486fb7b463 tempest-ServerActionsTestOtherA-1711625355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:48 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" returned: 0 in 0.592s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.965s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Creating offline snapshot 9a26a945-a1de-4715-9acc-787b7c25f069 of volume 4c61526f-6ac6-4a8d-9ccd-8393c3418300 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f062e221-07c2-47d8-b8fa-afc37750e324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b371f5-1d87-4d24-8646-7e7781295a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0841cf4-bdf1-4c51-bfae-85c7d856e0ee]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:48 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Volume volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b (d8f3bb72-696f-4b92-93f2-96470fd1ce7b): created successfully Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b371f5-1d87-4d24-8646-7e7781295a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Flow 'volume_create_manager' (ec5f32cf-b22c-4a1e-9b5b-3c851e0d79b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b0879694-ef33-499f-8651-08d925ac0759 tempest-VolumesSnapshotTestJSON-297675284 None] Created volume successfully. Jun 03 14:45:48 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 Jun 03 14:45:48 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:49 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300" returned: 0 in 0.682s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:49 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 1G Jun 03 14:45:49 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:50 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 1G" returned: 0 in 0.745s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:50 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 Jun 03 14:45:50 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:50 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069" returned: 0 in 0.635s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:50 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 is being set with open permissions: ugo+rw Jun 03 14:45:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:50 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 Jun 03 14:45:50 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:51 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069" returned: 0 in 0.591s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:51 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.info Jun 03 14:45:51 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:52 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.info" returned: 0 in 0.632s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:52 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.info is being set with open permissions: ugo+rw Jun 03 14:45:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:52 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.info Jun 03 14:45:52 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:52 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.info" returned: 0 in 0.594s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.971s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-3d2df350-7380-4ae6-a42d-9b086e8d5c4d req-99d660a8-e1d9-40e6-9c5e-bc486fb7b463 tempest-ServerActionsTestOtherA-1711625355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.332s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:52 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79dc0de-ab8d-4862-8895-25eb76cb90a8]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3d2df350-7380-4ae6-a42d-9b086e8d5c4d req-99d660a8-e1d9-40e6-9c5e-bc486fb7b463 tempest-ServerActionsTestOtherA-1711625355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:52 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ce000fa0-2106-490a-bdaf-81cd85af734d tempest-VolumesDeleteCascade-419599363 None] Create snapshot completed successfully Jun 03 14:45:52 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 Jun 03 14:45:52 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:53 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3d2df350-7380-4ae6-a42d-9b086e8d5c4d req-99d660a8-e1d9-40e6-9c5e-bc486fb7b463 tempest-ServerActionsTestOtherA-1711625355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8" returned: 0 in 0.743s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-3d2df350-7380-4ae6-a42d-9b086e8d5c4d req-99d660a8-e1d9-40e6-9c5e-bc486fb7b463 tempest-ServerActionsTestOtherA-1711625355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.766s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.734s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Creating offline snapshot 793cd4b2-6873-43da-9d97-93b9ebd6f103 of volume d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4585cb7d-4db3-4909-b209-c382c912c607]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-3d2df350-7380-4ae6-a42d-9b086e8d5c4d req-99d660a8-e1d9-40e6-9c5e-bc486fb7b463 tempest-ServerActionsTestOtherA-1711625355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-f983f0b7-8990-4258-986c-60a8061767f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53c3eb64-57d2-476e-8cd8-f14e038cc8dc', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:45:53 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:45:53 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:53 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-3d2df350-7380-4ae6-a42d-9b086e8d5c4d req-99d660a8-e1d9-40e6-9c5e-bc486fb7b463 tempest-ServerActionsTestOtherA-1711625355 None] attachment_update completed successfully. Jun 03 14:45:53 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b Jun 03 14:45:53 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:54 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.620s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:45:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:45:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 8 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:45:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:45:54 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" returned: 0 in 0.699s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:54 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 1G Jun 03 14:45:54 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:55 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 1G" returned: 0 in 0.752s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:55 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 Jun 03 14:45:55 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:55 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103" returned: 0 in 0.632s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:55 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 is being set with open permissions: ugo+rw Jun 03 14:45:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:55 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 Jun 03 14:45:55 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:56 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103" returned: 0 in 0.620s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=100,cinder:UPDATE=90,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=83,cinder:UPDATE=98,cinder:INSERT=22,cinder:DELETE=10 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:56 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.info Jun 03 14:45:56 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Flow 'volume_create_manager' (67f45585-9ee2-43b8-bd08-84bff11af992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12e6c9b-2ffc-4fa3-a1d3-64e40cd4f4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12e6c9b-2ffc-4fa3-a1d3-64e40cd4f4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-19693545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec5cf22-51c7-4d9f-8248-1af711b2d420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd4fbd50ac34e36be18dbbc4f840b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:56Z,use_quota=True,user_id='90641535c0cb4ae8ba381609722ca799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74f4c3c-f24b-4f92-b7ea-e1a14fc80d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74f4c3c-f24b-4f92-b7ea-e1a14fc80d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cacb7f-9ade-490a-b7bf-be736809e857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cacb7f-9ade-490a-b7bf-be736809e857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ec5cf22-51c7-4d9f-8248-1af711b2d420', 'volume_name': 'volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbf51ba-344a-4ed4-a21d-abc96e0c565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbf51ba-344a-4ed4-a21d-abc96e0c565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18fcc77-cbbf-4446-9bdd-df562d331b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:56 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Volume 4ec5cf22-51c7-4d9f-8248-1af711b2d420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420', 'volume_size': 1} Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:56 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.info" returned: 0 in 0.636s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:56 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.info is being set with open permissions: ugo+rw Jun 03 14:45:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:57 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.info Jun 03 14:45:57 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:57 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.info" returned: 0 in 0.595s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.028s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:45:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.390s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:45:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] Creating offline snapshot 819b3ce0-cf93-4d7f-8613-86943486a66f of volume 4c61526f-6ac6-4a8d-9ccd-8393c3418300 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:45:57 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ca9cf412-108d-430b-ada6-04d176332bfe tempest-VolumesSnapshotTestJSON-297675284 None] Create snapshot completed successfully Jun 03 14:45:57 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[db029524-29b9-4cba-b05c-34ec16143b33]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:45:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:57 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 Jun 03 14:45:57 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:58 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069" returned: 0 in 0.720s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:58 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f 1G Jun 03 14:45:58 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Flow 'volume_create_manager' (dbc857ed-3ac6-4437-84a5-b9d47e80367b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89876592-1307-4d4e-931b-3a80d07e5ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89876592-1307-4d4e-931b-3a80d07e5ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1954661355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e609bcb2-81e0-4113-af47-e53997ab79fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a45dbf9aa94c6c957be78a9d8c50d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=793cd4b2-6873-43da-9d97-93b9ebd6f103,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:59Z,use_quota=True,user_id='5d6257d7e44e42ed885ec3781728ec4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525174ca-abf4-41d1-8886-9c0a852d10a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525174ca-abf4-41d1-8886-9c0a852d10a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302152eb-a1a4-45c3-9e1f-bd29f19274aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302152eb-a1a4-45c3-9e1f-bd29f19274aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e609bcb2-81e0-4113-af47-e53997ab79fb', 'volume_name': 'volume-e609bcb2-81e0-4113-af47-e53997ab79fb', 'volume_size': 1, 'snapshot_id': '793cd4b2-6873-43da-9d97-93b9ebd6f103'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b882fa87-b9db-4810-9095-2cc0be975a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b882fa87-b9db-4810-9095-2cc0be975a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2b9285-565e-47ef-bdd1-eef353544a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:45:58 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Volume e609bcb2-81e0-4113-af47-e53997ab79fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e609bcb2-81e0-4113-af47-e53997ab79fb', 'volume_size': 1, 'snapshot_id': '793cd4b2-6873-43da-9d97-93b9ebd6f103'} Jun 03 14:45:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:45:59 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Jun 03 14:45:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f 1G" returned: 0 in 0.959s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:45:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:45:59 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f Jun 03 14:45:59 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:00 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f" returned: 0 in 0.779s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:00 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f is being set with open permissions: ugo+rw Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:00 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f Jun 03 14:46:00 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:00 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f" returned: 0 in 0.667s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.303s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-19693545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec5cf22-51c7-4d9f-8248-1af711b2d420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd4fbd50ac34e36be18dbbc4f840b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:45:56Z,use_quota=True,user_id='90641535c0cb4ae8ba381609722ca799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Creating volume 4ec5cf22-51c7-4d9f-8248-1af711b2d420 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:46:00 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:46:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:00 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 1073741824 Jun 03 14:46:00 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:00 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ce5a3847-7aa0-45fa-831b-0c58448fb82c tempest-VolumesDeleteCascade-419599363 None] Create snapshot completed successfully Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-4c61526f-6ac6-4a8d-9ccd-8393c3418300-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-4c61526f-6ac6-4a8d-9ccd-8393c3418300-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Performing cascade delete. {{(pid=86614) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-819b3ce0-cf93-4d7f-8613-86943486a66f-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-819b3ce0-cf93-4d7f-8613-86943486a66f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-4c61526f-6ac6-4a8d-9ccd-8393c3418300" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-4c61526f-6ac6-4a8d-9ccd-8393c3418300" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-819b3ce0-cf93-4d7f-8613-86943486a66f" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:01 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-819b3ce0-cf93-4d7f-8613-86943486a66f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Deleting offline snapshot 819b3ce0-cf93-4d7f-8613-86943486a66f of volume 4c61526f-6ac6-4a8d-9ccd-8393c3418300 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] snapshot_file for this snap is: volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 1073741824" returned: 0 in 1.100s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea841ee-531f-4ead-b136-7495eec4059d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:02 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 Jun 03 14:46:02 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:02 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f Jun 03 14:46:02 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:02 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420" returned: 0 in 0.730s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.049s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-793cd4b2-6873-43da-9d97-93b9ebd6f103-e609bcb2-81e0-4113-af47-e53997ab79fb" by "_create_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:02 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f" returned: 0 in 0.804s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18fcc77-cbbf-4446-9bdd-df562d331b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cce4016-c018-4018-a05f-3bfab515c9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[9029b48c-93da-4056-9138-da4da1ce80e7]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-793cd4b2-6873-43da-9d97-93b9ebd6f103-e609bcb2-81e0-4113-af47-e53997ab79fb" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Creating volume e609bcb2-81e0-4113-af47-e53997ab79fb from snapshot 793cd4b2-6873-43da-9d97-93b9ebd6f103 {{(pid=86614) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-e609bcb2-81e0-4113-af47-e53997ab79fb" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:02 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Volume volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 (4ec5cf22-51c7-4d9f-8248-1af711b2d420): created successfully Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cce4016-c018-4018-a05f-3bfab515c9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Flow 'volume_create_manager' (67f45585-9ee2-43b8-bd08-84bff11af992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-e609bcb2-81e0-4113-af47-e53997ab79fb" acquired by "_copy_volume_from_snapshot" :: waited 0.062s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] snapshot: 793cd4b2-6873-43da-9d97-93b9ebd6f103, volume: e609bcb2-81e0-4113-af47-e53997ab79fb, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 14:46:02 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ccf9a03d-0b04-4f90-bb66-601b6beac24d tempest-AttachVolumeNegativeTest-1795286255 None] Created volume successfully. Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da324a8-3809-46dd-823f-8f55998b423e]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:03 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 Jun 03 14:46:03 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:03 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 Jun 03 14:46:03 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:03 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069" returned: 0 in 0.859s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:03 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f Jun 03 14:46:03 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:03 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103" returned: 0 in 0.811s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 14:46:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 14:46:03 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09508a9-123c-417f-abc5-be380db2adfd]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:03 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b Jun 03 14:46:03 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:04 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f" returned: 0 in 0.751s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:04 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f Jun 03 14:46:04 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:04 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" returned: 0 in 0.720s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:04 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 14:46:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:04 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb Jun 03 14:46:04 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:05 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.819b3ce0-cf93-4d7f-8613-86943486a66f" returned: 0 in 0.573s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-819b3ce0-cf93-4d7f-8613-86943486a66f" released by "_delete_snapshot" :: held 3.135s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-4c61526f-6ac6-4a8d-9ccd-8393c3418300" released by "delete_snapshot" :: held 3.167s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Created reservations ['93390436-a7a2-4524-8a8c-914ce4af25d8', '9d3ca965-430a-4142-9915-41cfc575cd5f', 'cf5c500c-5e76-4619-9312-c46c209f2f0e', 'bd5ccf2b-2070-4080-8149-c2d5e8f4bb6c'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:05 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Delete snapshot completed successfully. Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-819b3ce0-cf93-4d7f-8613-86943486a66f-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-9a26a945-a1de-4715-9acc-787b7c25f069-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-9a26a945-a1de-4715-9acc-787b7c25f069-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-4c61526f-6ac6-4a8d-9ccd-8393c3418300" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-4c61526f-6ac6-4a8d-9ccd-8393c3418300" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-9a26a945-a1de-4715-9acc-787b7c25f069" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-9a26a945-a1de-4715-9acc-787b7c25f069" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Deleting offline snapshot 9a26a945-a1de-4715-9acc-787b7c25f069 of volume 4c61526f-6ac6-4a8d-9ccd-8393c3418300 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] snapshot_file for this snap is: volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[35505e00-2734-499a-a404-f2737a2516c8]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:05 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 Jun 03 14:46:05 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-0b733cdd-2761-4032-95d6-72a6348da959 req-22b695b8-f0b1-4833-a693-d3620da754bc tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:07 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069" returned: 0 in 2.210s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:07 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ad2326-e49a-45a0-9eec-0ea47a86b7a7]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:08 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 Jun 03 14:46:08 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:09 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300" returned: 0 in 2.295s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:10 devstack sudo[92119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 Jun 03 14:46:10 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:11 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb" returned: 0 in 6.852s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:11 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[570aa712-063b-48c8-a81f-fb222413673b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:11 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b Jun 03 14:46:11 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:11 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069" returned: 0 in 1.557s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:11 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069 Jun 03 14:46:11 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:12 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300.9a26a945-a1de-4715-9acc-787b7c25f069" returned: 0 in 0.598s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-9a26a945-a1de-4715-9acc-787b7c25f069" released by "_delete_snapshot" :: held 6.855s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-4c61526f-6ac6-4a8d-9ccd-8393c3418300" released by "delete_snapshot" :: held 6.880s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Created reservations ['c7ece492-c680-4896-99ec-d1d474cd70d9', '44475a7b-e93d-4875-b2a4-bc2eb4eb81df', 'a45d127e-ce75-4bb5-bd4f-06a9ed19242e', 'f4428142-8b2c-4a63-a493-c147994e8b31'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:12 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Delete snapshot completed successfully. Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-9a26a945-a1de-4715-9acc-787b7c25f069-delete_snapshot" released by "delete_snapshot" :: held 7.047s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Snapshots deleted, issuing volume delete {{(pid=86614) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-4c61526f-6ac6-4a8d-9ccd-8393c3418300" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-4c61526f-6ac6-4a8d-9ccd-8393c3418300" acquired by "delete_volume" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:12 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" returned: 0 in 0.953s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:46:12 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Converted 1024.00 MB image at 149.43 MB/s Jun 03 14:46:12 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb is being set with open permissions: ugo+rw Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e4bd47-cc6b-4f2d-b28b-c44d976c5c67]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:12 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb Jun 03 14:46:12 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:12 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 Jun 03 14:46:12 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:12 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb" returned: 0 in 0.651s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-e609bcb2-81e0-4113-af47-e53997ab79fb" released by "_copy_volume_from_snapshot" :: held 10.120s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-793cd4b2-6873-43da-9d97-93b9ebd6f103-e609bcb2-81e0-4113-af47-e53997ab79fb" released by "_create_volume_from_snapshot" :: held 10.207s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.267s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-0b733cdd-2761-4032-95d6-72a6348da959 req-22b695b8-f0b1-4833-a693-d3620da754bc tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.806s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc1bae7-bb22-4571-b8df-39de258be004]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-0b733cdd-2761-4032-95d6-72a6348da959 req-22b695b8-f0b1-4833-a693-d3620da754bc tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2b9285-565e-47ef-bdd1-eef353544a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e609bcb2-81e0-4113-af47-e53997ab79fb', 'volume_size': 1, 'snapshot_id': '793cd4b2-6873-43da-9d97-93b9ebd6f103'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38bed120-a54a-4d08-ab1d-d42df4903304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:13 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Volume volume-e609bcb2-81e0-4113-af47-e53997ab79fb (e609bcb2-81e0-4113-af47-e53997ab79fb): created successfully Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38bed120-a54a-4d08-ab1d-d42df4903304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Flow 'volume_create_manager' (dbc857ed-3ac6-4437-84a5-b9d47e80367b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:46:13 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a2af1452-7dad-462f-88cb-02703178683b tempest-VolumesSnapshotTestJSON-297675284 None] Created volume successfully. Jun 03 14:46:13 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300" returned: 0 in 0.847s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:13 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 Jun 03 14:46:13 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:13 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300 Jun 03 14:46:13 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-e609bcb2-81e0-4113-af47-e53997ab79fb-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-e609bcb2-81e0-4113-af47-e53997ab79fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-e609bcb2-81e0-4113-af47-e53997ab79fb" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-e609bcb2-81e0-4113-af47-e53997ab79fb" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[07707393-34bb-4ea4-b754-2dbe508c227d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:13 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb Jun 03 14:46:13 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:13 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4c61526f-6ac6-4a8d-9ccd-8393c3418300" returned: 0 in 0.654s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-4c61526f-6ac6-4a8d-9ccd-8393c3418300" released by "delete_volume" :: held 1.586s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:13 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-0b733cdd-2761-4032-95d6-72a6348da959 req-22b695b8-f0b1-4833-a693-d3620da754bc tempest-AttachVolumeNegativeTest-1795286255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420" returned: 0 in 0.831s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-0b733cdd-2761-4032-95d6-72a6348da959 req-22b695b8-f0b1-4833-a693-d3620da754bc tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.853s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-0b733cdd-2761-4032-95d6-72a6348da959 req-22b695b8-f0b1-4833-a693-d3620da754bc tempest-AttachVolumeNegativeTest-1795286255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d0cbb3b-aca8-43e9-ae19-64da25231d2e', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:46:13 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Created reservations ['e79e39c6-5199-4146-85e3-8492bee78c6f', '56a23da4-4e23-4147-92e4-8c7d9d7f8f8d', 'c93b6c0f-0eb5-4c9c-aef0-91ffe9b04c21', 'd58fe955-33c3-4f81-b778-0f3d32c7fd86'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:14 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-0b733cdd-2761-4032-95d6-72a6348da959 req-22b695b8-f0b1-4833-a693-d3620da754bc tempest-AttachVolumeNegativeTest-1795286255 None] attachment_update completed successfully. Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:14 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:46:14 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:14 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb" returned: 0 in 0.755s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:14 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb Jun 03 14:46:14 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:14 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.633s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:46:14 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Deleted volume successfully. Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-79ef144e-0455-45ee-ac8f-623f71d7ba6f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-4c61526f-6ac6-4a8d-9ccd-8393c3418300-delete_volume" released by "delete_volume" :: held 13.017s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Flow 'volume_create_manager' (30588789-f9b1-4e73-9c89-0327efab0d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a25aa0-d351-4c3a-80ea-bb33facc4801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a25aa0-d351-4c3a-80ea-bb33facc4801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1599551830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bc467e-120f-4381-9ca3-604884e878cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64279d03c0b4fe3903900ed9e5904bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:46:15Z,use_quota=True,user_id='372ae4cef563468f82ddbbc86dd846c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520e0aa6-1e0f-43d7-8cb2-84e1766196cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520e0aa6-1e0f-43d7-8cb2-84e1766196cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f1e665-af0f-43bb-921e-865f70aa5a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f1e665-af0f-43bb-921e-865f70aa5a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1bc467e-120f-4381-9ca3-604884e878cc', 'volume_name': 'volume-f1bc467e-120f-4381-9ca3-604884e878cc', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ce0c45-7d3f-4ae6-9a37-4d5bb9e964c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ce0c45-7d3f-4ae6-9a37-4d5bb9e964c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5cf260-2390-4bf5-9f36-0a6ce4bdec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:14 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Volume f1bc467e-120f-4381-9ca3-604884e878cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1bc467e-120f-4381-9ca3-604884e878cc', 'volume_size': 1} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1599551830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bc467e-120f-4381-9ca3-604884e878cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64279d03c0b4fe3903900ed9e5904bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:46:15Z,use_quota=True,user_id='372ae4cef563468f82ddbbc86dd846c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Creating volume f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:46:14 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:46:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:15 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc 1073741824 Jun 03 14:46:15 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:15 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e609bcb2-81e0-4113-af47-e53997ab79fb" returned: 0 in 0.716s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-e609bcb2-81e0-4113-af47-e53997ab79fb" released by "delete_volume" :: held 1.516s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Created reservations ['41fc36ef-dc70-41fb-94e3-a36833aa9498', 'ac764821-da44-461c-935d-3a62d63bb0dc', '8f69c7cc-1110-45fc-97e6-12fe53e68b71', 'e98c00cc-8346-484f-a6e4-234958ea4d78'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:15 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:46:15 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-793cd4b2-6873-43da-9d97-93b9ebd6f103-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:15 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc 1073741824" returned: 0 in 0.826s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:15 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-793cd4b2-6873-43da-9d97-93b9ebd6f103-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.631s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:46:15 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Deleted volume successfully. Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-793cd4b2-6873-43da-9d97-93b9ebd6f103" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298e91bf-9b0c-4976-bf66-782baa7fa43f tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-e609bcb2-81e0-4113-af47-e53997ab79fb-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-793cd4b2-6873-43da-9d97-93b9ebd6f103" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Deleting offline snapshot 793cd4b2-6873-43da-9d97-93b9ebd6f103 of volume d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:46:15 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc Jun 03 14:46:15 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] snapshot_file for this snap is: volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0050fcd-cc90-4f9d-a998-dd4fb4637958]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:16 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 Jun 03 14:46:16 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:16 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc" returned: 0 in 0.596s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5cf260-2390-4bf5-9f36-0a6ce4bdec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1bc467e-120f-4381-9ca3-604884e878cc', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e40481-945d-4e75-97c6-bfe38e2d2d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:16 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Volume volume-f1bc467e-120f-4381-9ca3-604884e878cc (f1bc467e-120f-4381-9ca3-604884e878cc): created successfully Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e40481-945d-4e75-97c6-bfe38e2d2d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Flow 'volume_create_manager' (30588789-f9b1-4e73-9c89-0327efab0d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:46:16 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5065f0e4-e721-4dbb-9b35-bd9308ddda4f tempest-VolumesDeleteCascade-419599363 None] Created volume successfully. Jun 03 14:46:16 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103" returned: 0 in 0.714s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[df019edc-8e83-4b6c-aabc-c9098d87c7da]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:16 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b Jun 03 14:46:16 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Creating offline snapshot 9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 of volume f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:46:17 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bf1594-45b1-4de1-a6b2-0ceb30c9b7f0]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:17 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc Jun 03 14:46:17 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:17 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" returned: 0 in 0.722s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:17 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 Jun 03 14:46:17 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:17 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc" returned: 0 in 0.728s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:17 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 1G Jun 03 14:46:17 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:18 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103" returned: 0 in 0.698s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:18 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103 Jun 03 14:46:18 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:18 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b.793cd4b2-6873-43da-9d97-93b9ebd6f103" returned: 0 in 0.622s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:18 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 1G" returned: 0 in 0.815s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1bc467e-120f-4381-9ca3-604884e878cc -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-793cd4b2-6873-43da-9d97-93b9ebd6f103" released by "_delete_snapshot" :: held 2.863s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" released by "delete_snapshot" :: held 2.913s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:18 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1bc467e-120f-4381-9ca3-604884e878cc -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 Jun 03 14:46:18 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:18 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Created reservations ['f4f8e464-c16b-437d-ba89-aa2807f3dad6', '37d7d6c3-f863-40db-8d5a-45e36cc33dc7', '4c6cba23-2f09-4393-9495-f5cdea2cc287', 'fb5008db-4aa2-47bf-a093-875ac37c9142'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:18 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Delete snapshot completed successfully. Jun 03 14:46:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-103bf7a5-545e-408a-bcca-5864ac7f85d6 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-793cd4b2-6873-43da-9d97-93b9ebd6f103-delete_snapshot" released by "delete_snapshot" :: held 3.063s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-d8f3bb72-696f-4b92-93f2-96470fd1ce7b-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-d8f3bb72-696f-4b92-93f2-96470fd1ce7b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:19 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[9870e127-97b3-4a32-ba45-f4e022c5e7f1]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:19 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b Jun 03 14:46:19 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:19 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1bc467e-120f-4381-9ca3-604884e878cc -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4" returned: 0 in 0.647s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:19 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 is being set with open permissions: ugo+rw Jun 03 14:46:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:19 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 Jun 03 14:46:19 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:19 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" returned: 0 in 0.775s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:19 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b Jun 03 14:46:19 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:20 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4" returned: 0 in 0.641s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:20 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.info Jun 03 14:46:20 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:20 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-99af22b8-cdb1-4bac-a589-d0a4376c9b33 req-5a537904-d1fb-4963-9d6a-85cfe96708b8 tempest-AttachVolumeNegativeTest-1795286255 None] Terminate volume connection completed successfully. Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-99af22b8-cdb1-4bac-a589-d0a4376c9b33 req-5a537904-d1fb-4963-9d6a-85cfe96708b8 tempest-AttachVolumeNegativeTest-1795286255 None] Deleting attachment 2d0cbb3b-aca8-43e9-ae19-64da25231d2e. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:46:20 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" returned: 0 in 0.691s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d8f3bb72-696f-4b92-93f2-96470fd1ce7b" released by "delete_volume" :: held 1.527s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Created reservations ['ec546f47-c5ad-42ae-99e4-722d0823146c', 'd56cca41-73d6-428b-b6cf-540b176d5489', '4300e1db-177e-4910-b8a6-7f7d975f21e9', '70e2da86-0199-4bdd-bb2d-9d50a89efd9c'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:20 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.info" returned: 0 in 0.697s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:20 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.info is being set with open permissions: ugo+rw Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:20 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.info Jun 03 14:46:20 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:20 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:46:20 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-d2c2bb5e-7ce5-452a-b123-3bcf63e49045-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-d2c2bb5e-7ce5-452a-b123-3bcf63e49045-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:21 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.681s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:46:21 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.info" returned: 0 in 0.718s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.364s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Deleted volume successfully. Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "cinder-quobyte-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8469bc8c-202e-4469-961b-6e4925df284b tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-d8f3bb72-696f-4b92-93f2-96470fd1ce7b-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d1ee190b-a2b9-4cfd-9e9d-78127d486aac tempest-VolumesDeleteCascade-419599363 None] Create snapshot completed successfully Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d507b91-850e-4a0a-87f0-09ba33870275]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:21 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 Jun 03 14:46:21 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:22 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" returned: 0 in 0.784s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:22 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045 Jun 03 14:46:22 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:22 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Flow 'volume_create_manager' (b6d1f093-0cfd-471a-b052-9fdc4745e182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f2214e-7d3a-45ea-b22e-70f60ee030d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f2214e-7d3a-45ea-b22e-70f60ee030d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-299851130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9443a6b8-d37c-44f0-b804-8bd093c191f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64279d03c0b4fe3903900ed9e5904bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a08a1e9-4815-43fd-b670-c9b3fdfde2b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:46:23Z,use_quota=True,user_id='372ae4cef563468f82ddbbc86dd846c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e6fb51-acb2-463d-b842-ddbdedd6d44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e6fb51-acb2-463d-b842-ddbdedd6d44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed19b1b1-e2fe-4bb7-8dd7-ce8743cd6c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed19b1b1-e2fe-4bb7-8dd7-ce8743cd6c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9443a6b8-d37c-44f0-b804-8bd093c191f4', 'volume_name': 'volume-9443a6b8-d37c-44f0-b804-8bd093c191f4', 'volume_size': 1, 'snapshot_id': '9a08a1e9-4815-43fd-b670-c9b3fdfde2b4'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cac483-1693-43d3-a2ff-0bad6748311d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cac483-1693-43d3-a2ff-0bad6748311d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdee2575-453e-431d-9dc2-9d35d264f72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:23 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Volume 9443a6b8-d37c-44f0-b804-8bd093c191f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9443a6b8-d37c-44f0-b804-8bd093c191f4', 'volume_size': 1, 'snapshot_id': '9a08a1e9-4815-43fd-b670-c9b3fdfde2b4'} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-9a08a1e9-4815-43fd-b670-c9b3fdfde2b4-9443a6b8-d37c-44f0-b804-8bd093c191f4" by "_create_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-9a08a1e9-4815-43fd-b670-c9b3fdfde2b4-9443a6b8-d37c-44f0-b804-8bd093c191f4" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Creating volume 9443a6b8-d37c-44f0-b804-8bd093c191f4 from snapshot 9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 {{(pid=86614) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-9443a6b8-d37c-44f0-b804-8bd093c191f4" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-9443a6b8-d37c-44f0-b804-8bd093c191f4" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] snapshot: 9a08a1e9-4815-43fd-b670-c9b3fdfde2b4, volume: 9443a6b8-d37c-44f0-b804-8bd093c191f4, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 14:46:23 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" returned: 0 in 0.763s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0275c0-6741-4c4a-8b70-eee33a8f3999]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-quobyte-d2c2bb5e-7ce5-452a-b123-3bcf63e49045" released by "delete_volume" :: held 1.612s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Created reservations ['061f79be-bb5e-43ed-a382-01f8cc410b05', 'd563c4c8-6723-47a9-a264-2610dfbf94c4', '48da3e5e-ab6f-4366-9bc2-4b496165301c', '6fe2a02f-8ecc-45df-a923-ee7938f6ac82'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:23 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 Jun 03 14:46:23 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:23 devstack sudo[92294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:46:23 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:24 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.975s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:24 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:46:24 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:24 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Deleted volume successfully. Jun 03 14:46:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4" returned: 0 in 1.138s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1bc467e-120f-4381-9ca3-604884e878cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 14:46:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 14:46:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e583ed51-1331-4a05-a998-19cc3ebae1a5 tempest-VolumesSnapshotTestJSON-297675284 None] Lock "cinder-d2c2bb5e-7ce5-452a-b123-3bcf63e49045-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8ae09f-65ad-48b2-9107-b583d5f8b7ca]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:24 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-b2f61773-3926-4cb5-b15b-1d2136f018fa req-b2c50f50-b618-4265-8ede-65a8330984ec tempest-ServerActionsTestOtherA-1711625355 None] Terminate volume connection completed successfully. Jun 03 14:46:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-b2f61773-3926-4cb5-b15b-1d2136f018fa req-b2c50f50-b618-4265-8ede-65a8330984ec tempest-ServerActionsTestOtherA-1711625355 None] Deleting attachment 53c3eb64-57d2-476e-8cd8-f14e038cc8dc. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:46:24 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc Jun 03 14:46:24 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:25 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc" returned: 0 in 0.962s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:25 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 14:46:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:25 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 Jun 03 14:46:25 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:31 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4" returned: 0 in 6.300s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:31 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b82df9-b1f5-4d48-8796-7c183d0c86e6]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:31 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc Jun 03 14:46:31 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:32 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc" returned: 0 in 1.305s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:32 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:46:32 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Converted 1024.00 MB image at 162.47 MB/s Jun 03 14:46:32 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 is being set with open permissions: ugo+rw Jun 03 14:46:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:33 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 Jun 03 14:46:33 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:33 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4" returned: 0 in 0.738s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-9443a6b8-d37c-44f0-b804-8bd093c191f4" released by "_copy_volume_from_snapshot" :: held 10.580s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-9a08a1e9-4815-43fd-b670-c9b3fdfde2b4-9443a6b8-d37c-44f0-b804-8bd093c191f4" released by "_create_volume_from_snapshot" :: held 10.615s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.639s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdee2575-453e-431d-9dc2-9d35d264f72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9443a6b8-d37c-44f0-b804-8bd093c191f4', 'volume_size': 1, 'snapshot_id': '9a08a1e9-4815-43fd-b670-c9b3fdfde2b4'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f16424-d02b-4ad1-b256-213461137a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:33 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Volume volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 (9443a6b8-d37c-44f0-b804-8bd093c191f4): created successfully Jun 03 14:46:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f16424-d02b-4ad1-b256-213461137a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Flow 'volume_create_manager' (b6d1f093-0cfd-471a-b052-9fdc4745e182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:46:33 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c898c1c3-afbb-4fc8-a7b9-ea3b67a43256 tempest-VolumesDeleteCascade-419599363 None] Created volume successfully. Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-f1bc467e-120f-4381-9ca3-604884e878cc-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-f1bc467e-120f-4381-9ca3-604884e878cc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Performing cascade delete. {{(pid=86614) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-9a08a1e9-4815-43fd-b670-c9b3fdfde2b4-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-9a08a1e9-4815-43fd-b670-c9b3fdfde2b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-f1bc467e-120f-4381-9ca3-604884e878cc" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-f1bc467e-120f-4381-9ca3-604884e878cc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-9a08a1e9-4815-43fd-b670-c9b3fdfde2b4" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-9a08a1e9-4815-43fd-b670-c9b3fdfde2b4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Deleting offline snapshot 9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 of volume f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] snapshot_file for this snap is: volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80919cc-ba0f-4116-b691-ccf17d997988]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:34 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 Jun 03 14:46:34 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:35 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4" returned: 0 in 0.739s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1bc467e-120f-4381-9ca3-604884e878cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:35 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6ac540-259d-4921-a709-f68b7a357066]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:35 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc Jun 03 14:46:35 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Flow 'volume_create_manager' (fedea54c-c55c-4110-b72c-9e45fcce612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af56cb00-2c6c-4f84-a16e-700ebc3e6443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af56cb00-2c6c-4f84-a16e-700ebc3e6443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1078048861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f58ccef-0920-4d84-857b-aef4e37c42b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93709896bbd44eb997d8900c8d191ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:46:36Z,use_quota=True,user_id='7426bb39b82a4d3a909406b862db62de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718cc9dd-d4c1-4395-934f-ad8e1b2a7c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718cc9dd-d4c1-4395-934f-ad8e1b2a7c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1c0c5e-2f0f-4ec0-b88c-e840db7a62cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1c0c5e-2f0f-4ec0-b88c-e840db7a62cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f58ccef-0920-4d84-857b-aef4e37c42b9', 'volume_name': 'volume-2f58ccef-0920-4d84-857b-aef4e37c42b9', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a1a05f-e825-40f4-b8d0-d74a68c911d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a1a05f-e825-40f4-b8d0-d74a68c911d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f55cd5-ac0d-4fee-9f41-0ccefc4704e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:36 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Volume 2f58ccef-0920-4d84-857b-aef4e37c42b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f58ccef-0920-4d84-857b-aef4e37c42b9', 'volume_size': 1} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1078048861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f58ccef-0920-4d84-857b-aef4e37c42b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93709896bbd44eb997d8900c8d191ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:46:36Z,use_quota=True,user_id='7426bb39b82a4d3a909406b862db62de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Creating volume 2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:46:36 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:36 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 1073741824 Jun 03 14:46:36 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:36 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc" returned: 0 in 0.855s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:36 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 Jun 03 14:46:36 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:37 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 1073741824" returned: 0 in 0.895s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:37 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 Jun 03 14:46:37 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:37 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4" returned: 0 in 0.770s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:37 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4 Jun 03 14:46:37 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:37 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9" returned: 0 in 0.627s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f55cd5-ac0d-4fee-9f41-0ccefc4704e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f58ccef-0920-4d84-857b-aef4e37c42b9', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267a1845-139b-4e0b-9358-83bdb556fc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:37 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Volume volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 (2f58ccef-0920-4d84-857b-aef4e37c42b9): created successfully Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267a1845-139b-4e0b-9358-83bdb556fc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Flow 'volume_create_manager' (fedea54c-c55c-4110-b72c-9e45fcce612c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:46:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-484d1944-40c1-49a8-a511-2d5ecc441ed9 tempest-VolumesSnapshotListTestJSON-212720293 None] Created volume successfully. Jun 03 14:46:37 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc.9a08a1e9-4815-43fd-b670-c9b3fdfde2b4" returned: 0 in 0.750s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-9a08a1e9-4815-43fd-b670-c9b3fdfde2b4" released by "_delete_snapshot" :: held 3.231s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-f1bc467e-120f-4381-9ca3-604884e878cc" released by "delete_snapshot" :: held 3.256s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Acquiring lock "cinder-f983f0b7-8990-4258-986c-60a8061767f8-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Created reservations ['f787ed82-0513-48fb-b1e9-8cbf791d6463', '5a87583f-4702-45eb-9c16-6297b33679ed', 'fface0e2-ea11-4640-a8c5-fea9e596af79', '770230c3-439d-4c92-b178-1909414f35f9'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Lock "cinder-f983f0b7-8990-4258-986c-60a8061767f8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Acquiring lock "cinder-quobyte-f983f0b7-8990-4258-986c-60a8061767f8" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:38 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Delete snapshot completed successfully. Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-9a08a1e9-4815-43fd-b670-c9b3fdfde2b4-delete_snapshot" released by "delete_snapshot" :: held 3.498s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Snapshots deleted, issuing volume delete {{(pid=86614) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-f1bc467e-120f-4381-9ca3-604884e878cc" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Lock "cinder-quobyte-f983f0b7-8990-4258-986c-60a8061767f8" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-f1bc467e-120f-4381-9ca3-604884e878cc" acquired by "delete_volume" :: waited 0.032s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b28581-9bb1-41c5-9247-55deda854547]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[94616e63-1922-4c3e-a507-e0cbd79aafda]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:38 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 Jun 03 14:46:38 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Creating offline snapshot b4f08c6a-3482-41b2-b589-a6d2bb1db4fa of volume 2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:46:38 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc Jun 03 14:46:38 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b201c442-557c-45ae-aca0-9083ac113e27]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:38 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 Jun 03 14:46:38 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:39 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8" returned: 0 in 0.822s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:39 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc" returned: 0 in 0.824s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:39 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8 Jun 03 14:46:39 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:39 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc Jun 03 14:46:39 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:39 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9" returned: 0 in 0.820s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:39 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa 1G Jun 03 14:46:39 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:39 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f1bc467e-120f-4381-9ca3-604884e878cc" returned: 0 in 0.621s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:39 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f983f0b7-8990-4258-986c-60a8061767f8" returned: 0 in 0.651s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-f1bc467e-120f-4381-9ca3-604884e878cc" released by "delete_volume" :: held 1.516s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Lock "cinder-quobyte-f983f0b7-8990-4258-986c-60a8061767f8" released by "delete_volume" :: held 1.560s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Created reservations ['13e32677-cd06-40e0-8c08-0ffa9d04b2d1', '20bbb8a5-e0d4-4f39-bb5c-1b2c01e3ed63', '3b5fac99-b70a-40ea-bbd9-d09207bd0dc4', '3a4d3c00-7392-494b-a245-6da719097bac'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Created reservations ['4b8ac551-cf21-42d1-9e3e-6ab6f4ce2c1e', '7e013843-9d44-4cde-8bd0-7bc69c413681', '0163ecf5-5dc5-4ad2-a09a-5ee82110974e', 'be5702db-59d9-4784-a547-b8076dd0fe14'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:39 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:46:39 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:40 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:46:40 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:40 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa 1G" returned: 0 in 0.814s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:40 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa Jun 03 14:46:40 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-9443a6b8-d37c-44f0-b804-8bd093c191f4-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-9443a6b8-d37c-44f0-b804-8bd093c191f4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "cinder-quobyte-9443a6b8-d37c-44f0-b804-8bd093c191f4" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-9443a6b8-d37c-44f0-b804-8bd093c191f4" acquired by "delete_volume" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f69883-2018-43c7-abca-883dc91bf9c7]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:40 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.743s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:40 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:46:40 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:40 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Deleted volume successfully. Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d5705c57-967a-4c91-83a0-af5b32124a9f tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-f1bc467e-120f-4381-9ca3-604884e878cc-delete_volume" released by "delete_volume" :: held 6.113s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:40 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.920s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:46:40 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Deleted volume successfully. Jun 03 14:46:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8948fa36-df40-45c8-a9a0-e14d63de6215 tempest-ServerActionsTestOtherA-1711625355 None] Lock "cinder-f983f0b7-8990-4258-986c-60a8061767f8-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:41 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa" returned: 0 in 0.934s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:41 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa is being set with open permissions: ugo+rw Jun 03 14:46:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:41 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa Jun 03 14:46:41 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:41 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4" returned: 0 in 0.882s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:41 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4 Jun 03 14:46:41 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:41 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa" returned: 0 in 0.744s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:41 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.info Jun 03 14:46:41 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:42 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9443a6b8-d37c-44f0-b804-8bd093c191f4" returned: 0 in 1.099s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-quobyte-9443a6b8-d37c-44f0-b804-8bd093c191f4" released by "delete_volume" :: held 2.088s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:42 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Created reservations ['f41bd28d-ed12-42cc-9245-dfa718585f3a', 'f3ea9d89-b71b-460e-aad6-3273bb03bd91', '82252ff5-d6e3-4d66-a4ac-1e1a215cfc45', '40e92dc5-fe57-4b8e-bd86-fd333e27127d'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:42 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:46:42 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:43 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.info" returned: 0 in 1.096s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:43 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.info is being set with open permissions: ugo+rw Jun 03 14:46:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:43 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.info Jun 03 14:46:43 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:43 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.info" returned: 0 in 0.944s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:44 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.611s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.120s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:44 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:46:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Deleted volume successfully. Jun 03 14:46:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-faf432b2-8381-448f-bf23-cbe2dd18895a tempest-VolumesSnapshotListTestJSON-212720293 None] Create snapshot completed successfully Jun 03 14:46:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88307578-f878-4238-97a1-91f9be845587 tempest-VolumesDeleteCascade-419599363 None] Lock "cinder-9443a6b8-d37c-44f0-b804-8bd093c191f4-delete_volume" released by "delete_volume" :: held 3.733s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] Creating offline snapshot 50be0188-8dfd-4ba9-96ed-b12c6d4d63bf of volume 2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:46:45 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e605c59-9381-406e-b705-68a3c5323245]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:45 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa Jun 03 14:46:45 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:45 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa" returned: 0 in 0.754s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f58ccef-0920-4d84-857b-aef4e37c42b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:45 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf 1G Jun 03 14:46:45 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:46 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf 1G" returned: 0 in 0.888s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:46 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf Jun 03 14:46:46 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Flow 'volume_create_manager' (453e8e2d-3765-4c12-934a-f963d30ad17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b405a11-7081-4f9e-9001-f26d116d6c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b405a11-7081-4f9e-9001-f26d116d6c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-557306390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09479a9-6546-4c56-b95f-a326d8c32e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724ab007a8b24ebdbfe03d10f1dab49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:46:47Z,use_quota=True,user_id='d2712f03abef4c4b8eadb39ed242b8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ba0b8e-d9b4-455c-aa99-e53672934dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ba0b8e-d9b4-455c-aa99-e53672934dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82dd3423-fef6-4ee7-a91d-47f96950b117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82dd3423-fef6-4ee7-a91d-47f96950b117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09479a9-6546-4c56-b95f-a326d8c32e16', 'volume_name': 'volume-b09479a9-6546-4c56-b95f-a326d8c32e16', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e7261-fe48-4439-ac00-1d88a53ba3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e7261-fe48-4439-ac00-1d88a53ba3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1d2c10-8906-49a9-bb3d-6e030a68fa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:47 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Volume b09479a9-6546-4c56-b95f-a326d8c32e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09479a9-6546-4c56-b95f-a326d8c32e16', 'volume_size': 1} Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:47 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf" returned: 0 in 0.696s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:47 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf is being set with open permissions: ugo+rw Jun 03 14:46:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:47 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf Jun 03 14:46:47 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:48 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf" returned: 0 in 0.617s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.086s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-557306390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09479a9-6546-4c56-b95f-a326d8c32e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724ab007a8b24ebdbfe03d10f1dab49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:46:47Z,use_quota=True,user_id='d2712f03abef4c4b8eadb39ed242b8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Creating volume b09479a9-6546-4c56-b95f-a326d8c32e16 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:46:48 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:48 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16 1073741824 Jun 03 14:46:48 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4b6bbafe-8ee0-4fa7-9841-698ab5cd308b tempest-VolumesSnapshotListTestJSON-212720293 None] Create snapshot completed successfully Jun 03 14:46:48 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16 1073741824" returned: 0 in 0.852s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:49 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16 Jun 03 14:46:49 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:49 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16" returned: 0 in 0.630s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.277s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] Creating offline snapshot 98705441-4c3c-48f3-83bb-b2041326a164 of volume 2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1d2c10-8906-49a9-bb3d-6e030a68fa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09479a9-6546-4c56-b95f-a326d8c32e16', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f90569-bcd0-40c1-ae0a-a45374c32d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf318e-ef8f-453a-8688-05ff113fa17b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:49 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Volume volume-b09479a9-6546-4c56-b95f-a326d8c32e16 (b09479a9-6546-4c56-b95f-a326d8c32e16): created successfully Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f90569-bcd0-40c1-ae0a-a45374c32d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:46:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Flow 'volume_create_manager' (453e8e2d-3765-4c12-934a-f963d30ad17a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:46:49 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-9032e82c-efa4-4712-b0db-9a3c016c82e6 tempest-VolumesMetadataTest-292402283 None] Created volume successfully. Jun 03 14:46:49 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf Jun 03 14:46:49 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:50 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf" returned: 0 in 0.986s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f58ccef-0920-4d84-857b-aef4e37c42b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:50 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 1G Jun 03 14:46:50 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Acquiring lock "cinder-b09479a9-6546-4c56-b95f-a326d8c32e16-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Lock "cinder-b09479a9-6546-4c56-b95f-a326d8c32e16-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Acquiring lock "cinder-quobyte-b09479a9-6546-4c56-b95f-a326d8c32e16" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Lock "cinder-quobyte-b09479a9-6546-4c56-b95f-a326d8c32e16" acquired by "delete_volume" :: waited 0.031s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:52 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8556c32-324a-4d25-837a-8a34b26edcb6]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:52 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16 Jun 03 14:46:52 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:52 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 1G" returned: 0 in 1.541s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:52 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 Jun 03 14:46:52 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:53 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16" returned: 0 in 1.579s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:53 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16 Jun 03 14:46:53 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:53 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:46:53 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:53 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164" returned: 0 in 1.603s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:53 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 is being set with open permissions: ugo+rw Jun 03 14:46:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:53 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 Jun 03 14:46:53 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:54 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.266s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:46:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:46:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 8 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:46:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:46:55 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164" returned: 0 in 1.174s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:55 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.435s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b09479a9-6546-4c56-b95f-a326d8c32e16" returned: 0 in 1.468s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Lock "cinder-quobyte-b09479a9-6546-4c56-b95f-a326d8c32e16" released by "delete_volume" :: held 3.113s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:55 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4011f731-3690-4c58-9942-42092febf03a tempest-VolumesSnapshotListTestJSON-212720293 None] Create snapshot completed successfully Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Created reservations ['1d32e206-05f6-429f-bd73-42aacfe0b66e', '0f2193a6-7c40-46bb-b8dd-36bd5ba111d6', 'df38c8ec-d8ac-4b23-90e8-f026c1231852', 'ff94fcf1-7cc1-44d6-bf8b-77286228fb4e'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:46:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:55 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:46:55 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:56 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.720s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:56 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:46:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Deleted volume successfully. Jun 03 14:46:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-81eeb42b-3652-4e22-bae6-01bc9bb2e502 tempest-VolumesMetadataTest-292402283 None] Lock "cinder-b09479a9-6546-4c56-b95f-a326d8c32e16-delete_volume" released by "delete_volume" :: held 4.201s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:46:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-98705441-4c3c-48f3-83bb-b2041326a164-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-98705441-4c3c-48f3-83bb-b2041326a164-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-quobyte-98705441-4c3c-48f3-83bb-b2041326a164" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:46:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-98705441-4c3c-48f3-83bb-b2041326a164" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:46:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Deleting offline snapshot 98705441-4c3c-48f3-83bb-b2041326a164 of volume 2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:46:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] snapshot_file for this snap is: volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:46:57 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ecd804-deba-4c6e-9a16-184140af2781]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:57 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 Jun 03 14:46:57 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:57 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164" returned: 0 in 0.952s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f58ccef-0920-4d84-857b-aef4e37c42b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:58 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52e3071-d931-49b4-9de6-3331b8f4f7e8]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:46:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:58 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf Jun 03 14:46:58 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:46:59 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Jun 03 14:46:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf" returned: 0 in 1.125s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:46:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f58ccef-0920-4d84-857b-aef4e37c42b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:46:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:46:59 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 Jun 03 14:46:59 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:00 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164" returned: 0 in 1.101s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:00 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164 Jun 03 14:47:00 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:00 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.98705441-4c3c-48f3-83bb-b2041326a164" returned: 0 in 0.685s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-98705441-4c3c-48f3-83bb-b2041326a164" released by "_delete_snapshot" :: held 4.022s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" released by "delete_snapshot" :: held 4.052s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=97,cinder:UPDATE=111,cinder:INSERT=30,cinder:DELETE=13 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=101,cinder:DELETE=7,cinder:UPDATE=110,cinder:INSERT=25 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Created reservations ['932db775-597e-41a6-b312-b1369a2a4b1b', 'f44f3b4d-2a13-4099-ab4b-3d6edfb72fb6', '6fdd2b2a-bae0-4513-9177-5c690c42d2e8', '8d366fb4-30bc-4d01-bcce-7eef527b64d1'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:47:01 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Delete snapshot completed successfully. Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0451aa7-eae9-4c94-b735-6344dcbf1efa tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-98705441-4c3c-48f3-83bb-b2041326a164-delete_snapshot" released by "delete_snapshot" :: held 4.318s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-50be0188-8dfd-4ba9-96ed-b12c6d4d63bf-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-50be0188-8dfd-4ba9-96ed-b12c6d4d63bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-quobyte-50be0188-8dfd-4ba9-96ed-b12c6d4d63bf" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-50be0188-8dfd-4ba9-96ed-b12c6d4d63bf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Deleting offline snapshot 50be0188-8dfd-4ba9-96ed-b12c6d4d63bf of volume 2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] snapshot_file for this snap is: volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[25593416-296b-4357-bf4d-315a0cbbe0df]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:01 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf Jun 03 14:47:01 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:02 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf" returned: 0 in 0.827s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f58ccef-0920-4d84-857b-aef4e37c42b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e0796b-540a-4ef2-a3e2-1d1ffdfcd102]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:02 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa Jun 03 14:47:02 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Flow 'volume_create_manager' (b904150b-8757-4a22-b974-ae53eda09e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5900abe0-ad6a-4ad0-9574-bb67655b056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5900abe0-ad6a-4ad0-9574-bb67655b056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2015611408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df518f3-b290-4efd-93b6-70c1061bc3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53be085d2ec4f80b6deccc6bc64f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:03Z,use_quota=True,user_id='b748deeebda84578b04eb123ffd8f90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fa79f7-b307-4425-9b0b-9d29ba195b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fa79f7-b307-4425-9b0b-9d29ba195b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfc2c96-ca6a-4434-b825-854f5e56c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfc2c96-ca6a-4434-b825-854f5e56c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df518f3-b290-4efd-93b6-70c1061bc3ee', 'volume_name': 'volume-8df518f3-b290-4efd-93b6-70c1061bc3ee', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31929a61-0c56-45b1-9329-1d427c5b1604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31929a61-0c56-45b1-9329-1d427c5b1604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ed6c4c-d5e9-4e27-9d40-71e3e4045a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:02 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Volume 8df518f3-b290-4efd-93b6-70c1061bc3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df518f3-b290-4efd-93b6-70c1061bc3ee', 'volume_size': 1} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2015611408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df518f3-b290-4efd-93b6-70c1061bc3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53be085d2ec4f80b6deccc6bc64f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:03Z,use_quota=True,user_id='b748deeebda84578b04eb123ffd8f90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Creating volume 8df518f3-b290-4efd-93b6-70c1061bc3ee {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:47:02 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:47:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:02 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee 1073741824 Jun 03 14:47:02 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:03 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa" returned: 0 in 0.850s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f58ccef-0920-4d84-857b-aef4e37c42b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:47:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:03 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf Jun 03 14:47:03 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:04 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee 1073741824" returned: 0 in 1.282s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:04 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf" returned: 0 in 0.993s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:04 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee Jun 03 14:47:04 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:04 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf Jun 03 14:47:04 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:04 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee" returned: 0 in 0.730s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ed6c4c-d5e9-4e27-9d40-71e3e4045a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df518f3-b290-4efd-93b6-70c1061bc3ee', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4bcb5e-4ba1-482e-9647-58d2c2f10e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:04 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Volume volume-8df518f3-b290-4efd-93b6-70c1061bc3ee (8df518f3-b290-4efd-93b6-70c1061bc3ee): created successfully Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4bcb5e-4ba1-482e-9647-58d2c2f10e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Flow 'volume_create_manager' (b904150b-8757-4a22-b974-ae53eda09e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:47:04 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.50be0188-8dfd-4ba9-96ed-b12c6d4d63bf" returned: 0 in 0.787s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:04 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-88eed505-2e50-4844-88ce-614ad47551c2 tempest-VolumesTransfersV355Test-1059141351 None] Created volume successfully. Jun 03 14:47:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-50be0188-8dfd-4ba9-96ed-b12c6d4d63bf" released by "_delete_snapshot" :: held 3.588s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" released by "delete_snapshot" :: held 3.617s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Created reservations ['bc4d0163-f90a-4ef0-aded-0731c1a20322', 'e8d0995f-94ff-4322-b9d8-af79b6ce811e', '50e5130c-4906-47b1-88ea-b290ff3bd56e', 'bbf81f91-6c89-45a8-b94a-106757199a24'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:47:05 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Delete snapshot completed successfully. Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dad92318-de1f-4383-941e-6ef85a588253 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-50be0188-8dfd-4ba9-96ed-b12c6d4d63bf-delete_snapshot" released by "delete_snapshot" :: held 3.759s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-b4f08c6a-3482-41b2-b589-a6d2bb1db4fa-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-b4f08c6a-3482-41b2-b589-a6d2bb1db4fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-quobyte-b4f08c6a-3482-41b2-b589-a6d2bb1db4fa" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-b4f08c6a-3482-41b2-b589-a6d2bb1db4fa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Deleting offline snapshot b4f08c6a-3482-41b2-b589-a6d2bb1db4fa of volume 2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] snapshot_file for this snap is: volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed440b7f-eedc-4ec0-a811-116ecd38a127]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:05 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa Jun 03 14:47:05 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:06 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-3e36a6a7-0781-4705-81d5-3206451a1a4e tempest-VolumesTransfersV355Test-1317914170 None] Transfer volume completed successfully. Jun 03 14:47:06 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa" returned: 0 in 0.874s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:06 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f58ccef-0920-4d84-857b-aef4e37c42b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:47:06 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[38db4557-0091-4d21-9f3b-613dd9629e42]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:06 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 Jun 03 14:47:06 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:07 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9" returned: 0 in 0.723s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:07 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa Jun 03 14:47:07 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Acquiring lock "cinder-8df518f3-b290-4efd-93b6-70c1061bc3ee-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Lock "cinder-8df518f3-b290-4efd-93b6-70c1061bc3ee-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Acquiring lock "cinder-quobyte-8df518f3-b290-4efd-93b6-70c1061bc3ee" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Lock "cinder-quobyte-8df518f3-b290-4efd-93b6-70c1061bc3ee" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:07 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[0871291f-9a2c-48c5-881d-50b7b87c55b4]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:07 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee Jun 03 14:47:07 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:08 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa" returned: 0 in 0.799s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:08 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa Jun 03 14:47:08 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:08 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee" returned: 0 in 0.808s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:08 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee Jun 03 14:47:08 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:08 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9.b4f08c6a-3482-41b2-b589-a6d2bb1db4fa" returned: 0 in 0.626s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-b4f08c6a-3482-41b2-b589-a6d2bb1db4fa" released by "_delete_snapshot" :: held 3.149s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" released by "delete_snapshot" :: held 3.177s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:08 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Created reservations ['866ea105-c12e-487d-b595-cd8b03ba113b', 'd6ad9d5f-d5ea-43b2-88ab-1130f178f180', 'ff6a2e6d-91de-4806-9273-7b9930a5a4a2', 'b82e3090-ebe4-4d09-a91b-f899622a958c'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:47:09 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Delete snapshot completed successfully. Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97f509a-2c42-4acf-af6f-03b576e72227 tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-b4f08c6a-3482-41b2-b589-a6d2bb1db4fa-delete_snapshot" released by "delete_snapshot" :: held 3.326s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:09 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8df518f3-b290-4efd-93b6-70c1061bc3ee" returned: 0 in 0.626s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Lock "cinder-quobyte-8df518f3-b290-4efd-93b6-70c1061bc3ee" released by "delete_volume" :: held 1.488s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Created reservations ['4649dc3f-06f5-4599-8977-ff9826008561', '50260cf2-8a09-4201-97ef-2e6d82c42147', '73ec3ed5-c748-4c93-9076-c74c0c915abc', 'b57faf75-55b3-4207-81a6-14cec787aff3'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:09 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:47:09 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:09 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.604s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:47:09 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Deleted volume successfully. Jun 03 14:47:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bef4d92-61ec-4598-8473-f5b72ea357b8 tempest-VolumesTransfersV355Test-1707549922 None] Lock "cinder-8df518f3-b290-4efd-93b6-70c1061bc3ee-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-2f58ccef-0920-4d84-857b-aef4e37c42b9-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-2f58ccef-0920-4d84-857b-aef4e37c42b9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9fc5c3-2af9-427d-99ef-722d41ff0476]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:10 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 Jun 03 14:47:10 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Flow 'volume_create_manager' (e4cb808c-adb6-4192-bd9a-89fa68b6802a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3177be4e-d8a2-4fed-ab81-2b16386a3cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3177be4e-d8a2-4fed-ab81-2b16386a3cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1839799495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86b0151-7375-4202-8d96-18fc9d575d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53be085d2ec4f80b6deccc6bc64f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:10Z,use_quota=True,user_id='b748deeebda84578b04eb123ffd8f90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f2711a-67fd-4b9f-b777-b15cbedb7b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f2711a-67fd-4b9f-b777-b15cbedb7b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089c28ad-b6e5-43e0-a9bf-f320a938b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089c28ad-b6e5-43e0-a9bf-f320a938b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86b0151-7375-4202-8d96-18fc9d575d94', 'volume_name': 'volume-a86b0151-7375-4202-8d96-18fc9d575d94', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933c83b1-fe30-4919-8964-2fbee66c7218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933c83b1-fe30-4919-8964-2fbee66c7218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da15646f-2abd-470d-a999-abad74450cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:10 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Volume a86b0151-7375-4202-8d96-18fc9d575d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86b0151-7375-4202-8d96-18fc9d575d94', 'volume_size': 1} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1839799495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86b0151-7375-4202-8d96-18fc9d575d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53be085d2ec4f80b6deccc6bc64f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:10Z,use_quota=True,user_id='b748deeebda84578b04eb123ffd8f90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Creating volume a86b0151-7375-4202-8d96-18fc9d575d94 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:47:10 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:47:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:10 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94 1073741824 Jun 03 14:47:10 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:11 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9" returned: 0 in 1.057s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:11 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9 Jun 03 14:47:11 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:11 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94 1073741824" returned: 0 in 1.215s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:11 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94 Jun 03 14:47:11 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:12 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2f58ccef-0920-4d84-857b-aef4e37c42b9" returned: 0 in 0.831s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-quobyte-2f58ccef-0920-4d84-857b-aef4e37c42b9" released by "delete_volume" :: held 2.017s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Created reservations ['6a11e842-95f7-46e2-8146-0db0b56dcd2b', 'aab3d2c0-c05d-4d11-8c6b-fd90765cdad0', '37c2289d-5dc2-44cf-a5bb-3c9b66559731', 'b76fe861-b9fd-41bd-a7bb-cde5d4af6e0e'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:12 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:47:12 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:12 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94" returned: 0 in 0.757s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da15646f-2abd-470d-a999-abad74450cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86b0151-7375-4202-8d96-18fc9d575d94', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db1717f-af31-428c-91d5-84c35a86e4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:12 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Volume volume-a86b0151-7375-4202-8d96-18fc9d575d94 (a86b0151-7375-4202-8d96-18fc9d575d94): created successfully Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db1717f-af31-428c-91d5-84c35a86e4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Flow 'volume_create_manager' (e4cb808c-adb6-4192-bd9a-89fa68b6802a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:47:12 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c59eb50b-35ae-4d6b-a1cd-9669d3dd1e50 tempest-VolumesTransfersV355Test-1059141351 None] Created volume successfully. Jun 03 14:47:13 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.775s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:13 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:47:13 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Deleted volume successfully. Jun 03 14:47:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-21257e52-01e9-4d34-a469-388f4c5efc5d tempest-VolumesSnapshotListTestJSON-212720293 None] Lock "cinder-2f58ccef-0920-4d84-857b-aef4e37c42b9-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Acquiring lock "cinder-a86b0151-7375-4202-8d96-18fc9d575d94-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Lock "cinder-a86b0151-7375-4202-8d96-18fc9d575d94-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Acquiring lock "cinder-quobyte-a86b0151-7375-4202-8d96-18fc9d575d94" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Lock "cinder-quobyte-a86b0151-7375-4202-8d96-18fc9d575d94" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:14 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b359535-346e-428b-be8a-5390ac66558f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:14 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94 Jun 03 14:47:14 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:14 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94" returned: 0 in 0.744s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:14 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94 Jun 03 14:47:14 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:15 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a86b0151-7375-4202-8d96-18fc9d575d94" returned: 0 in 0.732s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Lock "cinder-quobyte-a86b0151-7375-4202-8d96-18fc9d575d94" released by "delete_volume" :: held 1.529s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:15 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Created reservations ['a94e0e48-9308-418a-a1f3-54f4354b5dfa', 'e10b05f3-a933-4f79-b70f-9f42cf1b9967', '18a03f6e-9e8b-4533-a1d9-026dd0af77c6', '7dd0b22b-e189-4c2f-b400-5317189a8707'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:47:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:15 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:47:15 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Flow 'volume_create_manager' (cc5133d2-7008-4619-b07c-cf8495103328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20db9341-b104-4ccd-b3bd-ebe76a80450a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20db9341-b104-4ccd-b3bd-ebe76a80450a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1647160432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21274c20-f047-474a-b1af-d7c76bd2cbdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd4fbd50ac34e36be18dbbc4f840b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:16Z,use_quota=True,user_id='90641535c0cb4ae8ba381609722ca799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797f3848-99f4-4b7a-9fd8-27b3ccc270c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797f3848-99f4-4b7a-9fd8-27b3ccc270c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6a596a-89e8-4004-adf0-a2eb359b5223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6a596a-89e8-4004-adf0-a2eb359b5223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21274c20-f047-474a-b1af-d7c76bd2cbdb', 'volume_name': 'volume-21274c20-f047-474a-b1af-d7c76bd2cbdb', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36750df9-f6b8-4c31-99ac-4be468277fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36750df9-f6b8-4c31-99ac-4be468277fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9becd396-63a2-4861-a964-a415be2bbaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:16 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Volume 21274c20-f047-474a-b1af-d7c76bd2cbdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21274c20-f047-474a-b1af-d7c76bd2cbdb', 'volume_size': 1} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1647160432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21274c20-f047-474a-b1af-d7c76bd2cbdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd4fbd50ac34e36be18dbbc4f840b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:16Z,use_quota=True,user_id='90641535c0cb4ae8ba381609722ca799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Creating volume 21274c20-f047-474a-b1af-d7c76bd2cbdb {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:47:16 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:16 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb 1073741824 Jun 03 14:47:16 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:16 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.088s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:17 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:47:17 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Deleted volume successfully. Jun 03 14:47:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52c18bba-c890-4fe9-a98b-f22cad5f9e46 tempest-VolumesTransfersV355Test-1707549922 None] Lock "cinder-a86b0151-7375-4202-8d96-18fc9d575d94-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:17 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb 1073741824" returned: 0 in 1.412s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:17 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb Jun 03 14:47:17 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:18 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb" returned: 0 in 0.836s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:47:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.309s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9becd396-63a2-4861-a964-a415be2bbaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21274c20-f047-474a-b1af-d7c76bd2cbdb', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24297c91-2939-4ed8-8cd1-0ee989007a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:18 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Volume volume-21274c20-f047-474a-b1af-d7c76bd2cbdb (21274c20-f047-474a-b1af-d7c76bd2cbdb): created successfully Jun 03 14:47:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24297c91-2939-4ed8-8cd1-0ee989007a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Flow 'volume_create_manager' (cc5133d2-7008-4619-b07c-cf8495103328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:47:18 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-036d5d54-c1e6-4c30-906c-e93ae8b67b1c tempest-AttachVolumeNegativeTest-1795286255 None] Created volume successfully. Jun 03 14:47:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-6855c8f5-f3f0-426f-a815-9e0851039223 req-cc304192-3c66-4258-9625-0320261f79bb tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-6855c8f5-f3f0-426f-a815-9e0851039223 req-cc304192-3c66-4258-9625-0320261f79bb tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:22 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[951dc1b4-92fc-4004-ad2e-cd1a2e92eee2]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-6855c8f5-f3f0-426f-a815-9e0851039223 req-cc304192-3c66-4258-9625-0320261f79bb tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:23 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb Jun 03 14:47:23 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:23 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-6855c8f5-f3f0-426f-a815-9e0851039223 req-cc304192-3c66-4258-9625-0320261f79bb tempest-AttachVolumeNegativeTest-1795286255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb" returned: 0 in 0.897s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-6855c8f5-f3f0-426f-a815-9e0851039223 req-cc304192-3c66-4258-9625-0320261f79bb tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.917s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-6855c8f5-f3f0-426f-a815-9e0851039223 req-cc304192-3c66-4258-9625-0320261f79bb tempest-AttachVolumeNegativeTest-1795286255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-21274c20-f047-474a-b1af-d7c76bd2cbdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fce793b8-edb8-4165-af53-7b8c5b5afb32', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:47:23 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-6855c8f5-f3f0-426f-a815-9e0851039223 req-cc304192-3c66-4258-9625-0320261f79bb tempest-AttachVolumeNegativeTest-1795286255 None] attachment_update completed successfully. Jun 03 14:47:33 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-edd4a9be-c562-4387-ad93-2af347439d29 req-7e0c9506-aabb-40de-be60-48be9532fe65 tempest-AttachVolumeNegativeTest-1795286255 None] Terminate volume connection completed successfully. Jun 03 14:47:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-edd4a9be-c562-4387-ad93-2af347439d29 req-7e0c9506-aabb-40de-be60-48be9532fe65 tempest-AttachVolumeNegativeTest-1795286255 None] Deleting attachment fce793b8-edb8-4165-af53-7b8c5b5afb32. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Flow 'volume_create_manager' (91eac944-8cfe-4dee-88a7-3d3bfead29e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba0e38b-98c3-4b09-a656-4c40c195d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba0e38b-98c3-4b09-a656-4c40c195d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-404276744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d23d9b-653c-4385-aead-278f326ed407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094b39fcb0e744bc8ebbdb01f7c09118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:42Z,use_quota=True,user_id='32d851526f5442f08aaa27e9009b7f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09c12b6-c845-4658-8f15-c825abf5ca10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09c12b6-c845-4658-8f15-c825abf5ca10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5feed89f-6669-427f-8056-56ce9dad7d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5feed89f-6669-427f-8056-56ce9dad7d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d23d9b-653c-4385-aead-278f326ed407', 'volume_name': 'volume-83d23d9b-653c-4385-aead-278f326ed407', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0e4239-703a-42f4-b635-7465609774fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0e4239-703a-42f4-b635-7465609774fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc54747-1578-4e4a-a1b3-20fe0dba3920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:42 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Volume 83d23d9b-653c-4385-aead-278f326ed407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d23d9b-653c-4385-aead-278f326ed407', 'volume_size': 1} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-404276744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d23d9b-653c-4385-aead-278f326ed407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094b39fcb0e744bc8ebbdb01f7c09118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:42Z,use_quota=True,user_id='32d851526f5442f08aaa27e9009b7f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Creating volume 83d23d9b-653c-4385-aead-278f326ed407 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:47:42 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:47:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:42 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 1073741824 Jun 03 14:47:42 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:43 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 1073741824" returned: 0 in 1.323s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:44 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 Jun 03 14:47:44 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:44 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407" returned: 0 in 0.691s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:47:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc54747-1578-4e4a-a1b3-20fe0dba3920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d23d9b-653c-4385-aead-278f326ed407', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4009114-e330-4a50-918a-36321e485f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:44 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Volume volume-83d23d9b-653c-4385-aead-278f326ed407 (83d23d9b-653c-4385-aead-278f326ed407): created successfully Jun 03 14:47:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4009114-e330-4a50-918a-36321e485f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Flow 'volume_create_manager' (91eac944-8cfe-4dee-88a7-3d3bfead29e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:47:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4328fcc1-c7ce-4a84-8187-c070083b9a0d tempest-VolumesActionsTest-1306905526 None] Created volume successfully. Jun 03 14:47:48 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "cinder-21274c20-f047-474a-b1af-d7c76bd2cbdb-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:48 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-21274c20-f047-474a-b1af-d7c76bd2cbdb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:48 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "cinder-quobyte-21274c20-f047-474a-b1af-d7c76bd2cbdb" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:48 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-quobyte-21274c20-f047-474a-b1af-d7c76bd2cbdb" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:48 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea52afb-9e63-46b1-8af5-43c7aff8954b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:49 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb Jun 03 14:47:49 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:49 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb" returned: 0 in 0.862s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:49 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb Jun 03 14:47:49 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:50 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21274c20-f047-474a-b1af-d7c76bd2cbdb" returned: 0 in 0.828s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-quobyte-21274c20-f047-474a-b1af-d7c76bd2cbdb" released by "delete_volume" :: held 1.746s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:50 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Created reservations ['54c7ed33-fd1d-40f1-a31c-3f87599f26f4', '58d9b0cf-b734-4d95-aad2-e2f154bd4cdf', '0eac8f38-1804-46b9-8e1b-2aa87f6e2b95', '04b91ce2-0587-40fe-9074-2cc12a7509e3'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:47:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:50 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:47:50 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "cinder-4ec5cf22-51c7-4d9f-8248-1af711b2d420-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-4ec5cf22-51c7-4d9f-8248-1af711b2d420-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "cinder-quobyte-4ec5cf22-51c7-4d9f-8248-1af711b2d420" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-quobyte-4ec5cf22-51c7-4d9f-8248-1af711b2d420" acquired by "delete_volume" :: waited 0.075s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:51 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd566592-778c-4263-89f0-93da943f6ce6]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:52 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 Jun 03 14:47:52 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:52 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.326s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:52 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:47:52 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Deleted volume successfully. Jun 03 14:47:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9852e0b-d3ba-4bd1-b5a8-4cfa076f0aeb tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-21274c20-f047-474a-b1af-d7c76bd2cbdb-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:53 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420" returned: 0 in 1.364s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:53 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420 Jun 03 14:47:53 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:47:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:53 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:47:53 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:54 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4ec5cf22-51c7-4d9f-8248-1af711b2d420" returned: 0 in 1.646s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-quobyte-4ec5cf22-51c7-4d9f-8248-1af711b2d420" released by "delete_volume" :: held 3.198s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:54 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Created reservations ['99846327-0fca-4ef3-aa48-520f3b0c12f4', 'd857d6d5-68bc-4d40-ae8f-a84e27ca326a', '4c76170b-98b9-4f7b-940f-9a4550ca637e', 'f9b2e024-4ca6-4e90-8781-2b31a4686444'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:55 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:47:55 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:55 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.719s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 8 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:47:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:47:56 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.695s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:56 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:47:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Deleted volume successfully. Jun 03 14:47:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bbdcf8cc-e235-4018-af19-21d40794c4d9 tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-4ec5cf22-51c7-4d9f-8248-1af711b2d420-delete_volume" released by "delete_volume" :: held 5.519s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:47:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "cinder-f2b5233e-0596-46a3-93e4-fc11fd0a5a59-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-f2b5233e-0596-46a3-93e4-fc11fd0a5a59-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "cinder-quobyte-f2b5233e-0596-46a3-93e4-fc11fd0a5a59" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:47:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-quobyte-f2b5233e-0596-46a3-93e4-fc11fd0a5a59" acquired by "delete_volume" :: waited 0.033s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:47:57 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[353680e7-70f0-4e01-8d8f-dbe07d446edd]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:47:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:57 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 Jun 03 14:47:57 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Flow 'volume_create_manager' (eb785a27-baef-4365-9898-4f0588d738fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc5c23d-6a1d-454a-a424-b78f914dec7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc5c23d-6a1d-454a-a424-b78f914dec7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1508279956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a7df11-6324-41c4-845a-35856e939869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f5c88d1d9742599c2362daf1cf1741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:58Z,use_quota=True,user_id='47a5bd6d44a44049a04999ccc0649e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3db637-32df-4577-94ae-a37df01c5f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3db637-32df-4577-94ae-a37df01c5f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787e3e53-ade7-4c92-b449-021c2c7d7e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787e3e53-ade7-4c92-b449-021c2c7d7e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a7df11-6324-41c4-845a-35856e939869', 'volume_name': 'volume-57a7df11-6324-41c4-845a-35856e939869', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfe191f-1f8c-406e-a37e-1e79908b06ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfe191f-1f8c-406e-a37e-1e79908b06ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382fa1e8-3111-4d71-a178-bdb7b4e2b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:58 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Volume 57a7df11-6324-41c4-845a-35856e939869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a7df11-6324-41c4-845a-35856e939869', 'volume_size': 1} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1508279956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a7df11-6324-41c4-845a-35856e939869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f5c88d1d9742599c2362daf1cf1741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:58Z,use_quota=True,user_id='47a5bd6d44a44049a04999ccc0649e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Creating volume 57a7df11-6324-41c4-845a-35856e939869 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:47:58 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:58 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869 1073741824 Jun 03 14:47:58 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:58 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59" returned: 0 in 1.268s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:58 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59 Jun 03 14:47:58 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Flow 'volume_create_manager' (5e28fef8-97f3-41b1-8674-2fddf74d0af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d14e6c-1bdc-4c9f-b218-f078ff764d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d14e6c-1bdc-4c9f-b218-f078ff764d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-644135158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187a7240-c8f6-466e-b72a-04571f7413b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84432e6df34244ef8e2d625b08dee6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:59Z,use_quota=True,user_id='b36011268d044f24ab37ef4485b66b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77438776-7ad1-4073-ad84-284085cdf259),volume_type_id=77438776-7ad1-4073-ad84-284085cdf259)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b6a402-191b-4c44-9cfe-fd5e0cb9b364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b6a402-191b-4c44-9cfe-fd5e0cb9b364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b577df9-aefe-4e41-bfe9-2c1d8e5e9370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b577df9-aefe-4e41-bfe9-2c1d8e5e9370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '187a7240-c8f6-466e-b72a-04571f7413b1', 'volume_name': 'volume-187a7240-c8f6-466e-b72a-04571f7413b1', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b8751e-979d-4d3f-a376-74ed3b3a149e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b8751e-979d-4d3f-a376-74ed3b3a149e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db6a850-f6dc-4259-9a5b-ff5b7e168cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:47:59 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Volume 187a7240-c8f6-466e-b72a-04571f7413b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-187a7240-c8f6-466e-b72a-04571f7413b1', 'volume_size': 1} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:47:59 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869 1073741824" returned: 0 in 1.485s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:47:59 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869 Jun 03 14:47:59 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:47:59 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jun 03 14:47:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Flow 'volume_create_manager' (70f69dd2-4a39-4a82-a269-1c091a8d9bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17940b7d-7d69-4dd5-9d9e-b271548b6a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f2b5233e-0596-46a3-93e4-fc11fd0a5a59" returned: 0 in 1.329s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17940b7d-7d69-4dd5-9d9e-b271548b6a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-743539834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79201db4-bf76-4dae-b8cc-9eecbeddee74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84432e6df34244ef8e2d625b08dee6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:48:00Z,use_quota=True,user_id='b36011268d044f24ab37ef4485b66b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4b305a6-0a62-4b2c-8262-9b19257847e7),volume_type_id=f4b305a6-0a62-4b2c-8262-9b19257847e7)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b846dd-a220-4d7f-919a-6764765dc1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b846dd-a220-4d7f-919a-6764765dc1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a561c559-caa4-48e8-87b7-0510a9046c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a561c559-caa4-48e8-87b7-0510a9046c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79201db4-bf76-4dae-b8cc-9eecbeddee74', 'volume_name': 'volume-79201db4-bf76-4dae-b8cc-9eecbeddee74', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592875e8-3e67-4fa1-91b3-097d0a93bd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592875e8-3e67-4fa1-91b3-097d0a93bd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e1051f-6c10-4614-b804-c4c947939279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:00 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Volume 79201db4-bf76-4dae-b8cc-9eecbeddee74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79201db4-bf76-4dae-b8cc-9eecbeddee74', 'volume_size': 1} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-quobyte-f2b5233e-0596-46a3-93e4-fc11fd0a5a59" released by "delete_volume" :: held 2.818s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Created reservations ['bcead1a8-87b3-4033-b425-0d26719a0d0f', '0f6aec59-5e13-48bc-a946-eae3a97b2d7f', '1a1c4be0-d3cf-485d-8823-dee21bad97c9', '6da53176-6092-4135-8b19-c239b6b97035'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:00 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:48:00 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:00 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869" returned: 0 in 0.870s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] <== create_volume: return (2467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.470s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.154s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-644135158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187a7240-c8f6-466e-b72a-04571f7413b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84432e6df34244ef8e2d625b08dee6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:47:59Z,use_quota=True,user_id='b36011268d044f24ab37ef4485b66b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77438776-7ad1-4073-ad84-284085cdf259),volume_type_id=77438776-7ad1-4073-ad84-284085cdf259)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Creating volume 187a7240-c8f6-466e-b72a-04571f7413b1 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:48:00 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382fa1e8-3111-4d71-a178-bdb7b4e2b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a7df11-6324-41c4-845a-35856e939869', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:00 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 1073741824 Jun 03 14:48:00 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1386257-bcba-4871-8a60-ff7cee50c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:00 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Volume volume-57a7df11-6324-41c4-845a-35856e939869 (57a7df11-6324-41c4-845a-35856e939869): created successfully Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1386257-bcba-4871-8a60-ff7cee50c399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Flow 'volume_create_manager' (eb785a27-baef-4365-9898-4f0588d738fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:48:00 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-093bdba6-8ad6-4658-87a0-2b2086f6a831 tempest-ServerRescueNegativeTestJSON-1857363226 None] Created volume successfully. Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:INSERT=21,cinder:UPDATE=75,cinder:SELECT=66,cinder:DELETE=5 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=60,cinder:INSERT=20,cinder:UPDATE=90,cinder:DELETE=5 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:48:01 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Flow 'volume_create_manager' (88404c6c-d2d4-4eb7-8d2a-b2278b287573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3d07ef-de8e-4e07-8a2d-f39dc0327eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.092s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3d07ef-de8e-4e07-8a2d-f39dc0327eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-688831546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff02fffd-e3ae-4a42-b7e6-07bd8448b124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84432e6df34244ef8e2d625b08dee6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:48:01Z,use_quota=True,user_id='b36011268d044f24ab37ef4485b66b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffe52f31-2d6f-4399-aeab-adf4d3735204),volume_type_id=ffe52f31-2d6f-4399-aeab-adf4d3735204)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eac3a40-7013-4058-9e2b-9f70e308db6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eac3a40-7013-4058-9e2b-9f70e308db6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2055f39-fb1b-4226-a9e9-cf43b9d7aa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG cinder.image.glance [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Creating Keystone auth plugin from conf {{(pid=86614) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 14:48:01 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Deleted volume successfully. Jun 03 14:48:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a585ea91-b173-4237-8f48-0366a7e5e71a tempest-AttachVolumeNegativeTest-1795286255 None] Lock "cinder-f2b5233e-0596-46a3-93e4-fc11fd0a5a59-delete_volume" released by "delete_volume" :: held 4.422s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2055f39-fb1b-4226-a9e9-cf43b9d7aa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff02fffd-e3ae-4a42-b7e6-07bd8448b124', 'volume_name': 'volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124', 'volume_size': 1, 'image_id': '2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1988596702', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84432e6df34244ef8e2d625b08dee6d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'created_at': datetime.datetime(2026, 6, 3, 12, 47, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 47, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858/file', 'properties': {}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2f972d-99c2-46b9-bb82-83efc24b6efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2f972d-99c2-46b9-bb82-83efc24b6efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a9882f-95a9-4e26-ac10-0440fb8aa3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:02 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Volume ff02fffd-e3ae-4a42-b7e6-07bd8448b124: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124', 'volume_size': 1, 'image_id': '2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1988596702', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84432e6df34244ef8e2d625b08dee6d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'created_at': datetime.datetime(2026, 6, 3, 12, 47, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 47, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858/file', 'properties': {}}, 'image_service': } Jun 03 14:48:02 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Trying to clone ff02fffd-e3ae-4a42-b7e6-07bd8448b124 from image 2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'metadata': {}}]). {{(pid=86614) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 03 14:48:02 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 1073741824" returned: 0 in 1.714s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:02 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 Jun 03 14:48:02 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:03 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1" returned: 0 in 0.973s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] <== create_volume: return (2761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.764s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.231s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-743539834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79201db4-bf76-4dae-b8cc-9eecbeddee74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84432e6df34244ef8e2d625b08dee6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:48:00Z,use_quota=True,user_id='b36011268d044f24ab37ef4485b66b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4b305a6-0a62-4b2c-8262-9b19257847e7),volume_type_id=f4b305a6-0a62-4b2c-8262-9b19257847e7)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Creating volume 79201db4-bf76-4dae-b8cc-9eecbeddee74 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:48:03 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db6a850-f6dc-4259-9a5b-ff5b7e168cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-187a7240-c8f6-466e-b72a-04571f7413b1', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:03 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 1073741824 Jun 03 14:48:03 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c860cc-3c5e-4317-bff1-7225087c20ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:03 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Volume volume-187a7240-c8f6-466e-b72a-04571f7413b1 (187a7240-c8f6-466e-b72a-04571f7413b1): created successfully Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c860cc-3c5e-4317-bff1-7225087c20ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Flow 'volume_create_manager' (5e28fef8-97f3-41b1-8674-2fddf74d0af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:48:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-856be6d8-f280-4793-8a0f-e15c394b4373 tempest-TestInstancesWithCinderVolumes-745954434 None] Created volume successfully. Jun 03 14:48:05 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 1073741824" returned: 0 in 2.395s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:05 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 Jun 03 14:48:05 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:06 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74" returned: 0 in 0.885s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:06 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] <== create_volume: return (3360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:48:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.362s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e1051f-6c10-4614-b804-c4c947939279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79201db4-bf76-4dae-b8cc-9eecbeddee74', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467c71fd-380d-45f0-a37f-199aa990f58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:06 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Volume volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 (79201db4-bf76-4dae-b8cc-9eecbeddee74): created successfully Jun 03 14:48:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467c71fd-380d-45f0-a37f-199aa990f58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Flow 'volume_create_manager' (70f69dd2-4a39-4a82-a269-1c091a8d9bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:48:06 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b7b368bf-b569-4edc-928b-05a2a80a14d6 tempest-TestInstancesWithCinderVolumes-745954434 None] Created volume successfully. Jun 03 14:48:08 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD, size 20.69 MB, duration 6.45 sec {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 03 14:48:08 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Image download 20.69 MB at 3.21 MB/s Jun 03 14:48:08 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61b6864-8238-401b-bb34-89a544df4c13]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:09 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD Jun 03 14:48:09 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1a48f1d9-7315-4990-a7ce-72af94dc289c tempest-VolumesActionsTest-1306905526 None] Acquiring lock "cinder-83d23d9b-653c-4385-aead-278f326ed407" by "attach_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1a48f1d9-7315-4990-a7ce-72af94dc289c tempest-VolumesActionsTest-1306905526 None] Lock "cinder-83d23d9b-653c-4385-aead-278f326ed407" acquired by "attach_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:09 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1a48f1d9-7315-4990-a7ce-72af94dc289c tempest-VolumesActionsTest-1306905526 None] Attaching volume 83d23d9b-653c-4385-aead-278f326ed407 to instance 34f571a6-f333-4891-aabb-313744ac5240 at mountpoint /dev/vdb on host None. Jun 03 14:48:09 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD" returned: 0 in 0.966s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:09 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Temporary image 2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858 is fetched for user b36011268d044f24ab37ef4485b66b58. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 03 14:48:09 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1a48f1d9-7315-4990-a7ce-72af94dc289c tempest-VolumesActionsTest-1306905526 None] Attach volume completed successfully. Jun 03 14:48:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1a48f1d9-7315-4990-a7ce-72af94dc289c tempest-VolumesActionsTest-1306905526 None] Lock "cinder-83d23d9b-653c-4385-aead-278f326ed407" released by "attach_volume" :: held 0.238s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[3575177b-d945-4f38-a665-d4496cabd149]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:10 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD Jun 03 14:48:10 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5c06edcd-1812-461c-aee6-300c4049a67f tempest-VolumesActionsTest-1306905526 None] Acquiring lock "cinder-83d23d9b-653c-4385-aead-278f326ed407-detach_volume" by "detach_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5c06edcd-1812-461c-aee6-300c4049a67f tempest-VolumesActionsTest-1306905526 None] Lock "cinder-83d23d9b-653c-4385-aead-278f326ed407-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:10 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5c06edcd-1812-461c-aee6-300c4049a67f tempest-VolumesActionsTest-1306905526 None] Detaching volume 83d23d9b-653c-4385-aead-278f326ed407 from instance 34f571a6-f333-4891-aabb-313744ac5240. Jun 03 14:48:10 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5c06edcd-1812-461c-aee6-300c4049a67f tempest-VolumesActionsTest-1306905526 None] Detach volume completed successfully. Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5c06edcd-1812-461c-aee6-300c4049a67f tempest-VolumesActionsTest-1306905526 None] Lock "cinder-83d23d9b-653c-4385-aead-278f326ed407-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:10 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-688831546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff02fffd-e3ae-4a42-b7e6-07bd8448b124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84432e6df34244ef8e2d625b08dee6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:48:01Z,use_quota=True,user_id='b36011268d044f24ab37ef4485b66b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffe52f31-2d6f-4399-aeab-adf4d3735204),volume_type_id=ffe52f31-2d6f-4399-aeab-adf4d3735204)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Creating volume ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:48:10 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:48:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:10 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 1073741824 Jun 03 14:48:10 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:11 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 1073741824" returned: 0 in 1.098s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:12 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 Jun 03 14:48:12 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:13 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" returned: 0 in 1.254s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:48:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.431s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:13 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Attempting download of 2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'metadata': {}}])) to volume ff02fffd-e3ae-4a42-b7e6-07bd8448b124. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 03 14:48:13 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[766c0283-b957-4f58-a40c-0b88fd8ca4f6]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_o5g1mhf6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:13 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_o5g1mhf6 Jun 03 14:48:13 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:14 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_o5g1mhf6" returned: 0 in 0.999s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_o5g1mhf6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:14 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_o5g1mhf6 Jun 03 14:48:14 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:15 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:48:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Flow 'volume_create_manager' (9596e25b-78c0-4cb7-a365-a1372c0f0db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:48:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f239aebf-0b54-4623-898b-836188b6b121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f239aebf-0b54-4623-898b-836188b6b121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-182629429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163e39a2-1670-4165-8b97-fbe43295deb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92965b59683e455aaade0ad63a4d8b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:48:16Z,use_quota=True,user_id='431295ef56194580a3c7e72dc87d01e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d315b9f-66b9-455b-9200-6438984dca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d315b9f-66b9-455b-9200-6438984dca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f709f6f-2457-427a-990c-4cc5123b68ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f709f6f-2457-427a-990c-4cc5123b68ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163e39a2-1670-4165-8b97-fbe43295deb0', 'volume_name': 'volume-163e39a2-1670-4165-8b97-fbe43295deb0', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1af5011-ad42-4a9d-8c2d-990f3b9e6fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1af5011-ad42-4a9d-8c2d-990f3b9e6fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4ea327-be87-4348-9285-e43ca5392c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:16 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Volume 163e39a2-1670-4165-8b97-fbe43295deb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163e39a2-1670-4165-8b97-fbe43295deb0', 'volume_size': 1} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-182629429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163e39a2-1670-4165-8b97-fbe43295deb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92965b59683e455aaade0ad63a4d8b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:48:16Z,use_quota=True,user_id='431295ef56194580a3c7e72dc87d01e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Creating volume 163e39a2-1670-4165-8b97-fbe43295deb0 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:48:16 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:16 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_o5g1mhf6" returned: 1 in 1.740s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_o5g1mhf6' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:48:16 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 1073741824 Jun 03 14:48:16 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[febd05cc-b43c-47bc-b7ee-10f7f2c0e825]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:16 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD Jun 03 14:48:16 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:17 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD" returned: 0 in 0.872s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:17 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] 2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858 was qcow2, converting to raw {{(pid=86614) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 03 14:48:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:17 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 Jun 03 14:48:17 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:17 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 1073741824" returned: 0 in 1.162s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:17 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 Jun 03 14:48:17 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:18 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0" returned: 0 in 0.881s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:48:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4ea327-be87-4348-9285-e43ca5392c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163e39a2-1670-4165-8b97-fbe43295deb0', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fa1a5e-8e36-4989-bc4c-ca37deb53e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:18 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Volume volume-163e39a2-1670-4165-8b97-fbe43295deb0 (163e39a2-1670-4165-8b97-fbe43295deb0): created successfully Jun 03 14:48:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fa1a5e-8e36-4989-bc4c-ca37deb53e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Flow 'volume_create_manager' (9596e25b-78c0-4cb7-a365-a1372c0f0db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:48:18 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-342458c0-616a-474c-b50f-c5ee95e1aa24 req-088f5ebc-6b1a-4d71-9e51-a7f4d27d726d tempest-VolumesSnapshotsTestJSON-28270479 None] Created volume successfully. Jun 03 14:48:19 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" returned: 0 in 2.424s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:19 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858_qfmtmnssdevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:48:19 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Converted 112.00 MB image at 46.19 MB/s Jun 03 14:48:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:19 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 1G Jun 03 14:48:19 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Creating offline snapshot 924ea701-2fbc-485f-98c7-dc56a6fa653b of volume 163e39a2-1670-4165-8b97-fbe43295deb0 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:48:19 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f01086-807e-4f80-8404-30080fa8af16]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:19 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 Jun 03 14:48:19 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:20 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 1G" returned: 0 in 1.215s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:20 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfed4a8-9be9-4192-a0f8-7a1096beb56d]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:20 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 Jun 03 14:48:20 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:21 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0" returned: 0 in 1.529s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:21 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b 1G Jun 03 14:48:21 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:21 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" returned: 0 in 0.990s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:21 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 Jun 03 14:48:21 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:22 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b 1G" returned: 0 in 1.198s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-163e39a2-1670-4165-8b97-fbe43295deb0 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:22 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-163e39a2-1670-4165-8b97-fbe43295deb0 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b Jun 03 14:48:22 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Acquiring lock "cinder-57a7df11-6324-41c4-845a-35856e939869-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Lock "cinder-57a7df11-6324-41c4-845a-35856e939869-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Acquiring lock "cinder-quobyte-57a7df11-6324-41c4-845a-35856e939869" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Lock "cinder-quobyte-57a7df11-6324-41c4-845a-35856e939869" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:22 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[629955b6-d963-4070-b5ed-b8428500d3ea]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:22 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869 Jun 03 14:48:22 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:23 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" returned: 1 in 1.307s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Downloaded image 2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'metadata': {}}])) to volume ff02fffd-e3ae-4a42-b7e6-07bd8448b124 successfully. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Temporary image 2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858 for user b36011268d044f24ab37ef4485b66b58 is deleted. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Marking volume ff02fffd-e3ae-4a42-b7e6-07bd8448b124 as bootable. {{(pid=86614) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Copying metadata from image 2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858 to ff02fffd-e3ae-4a42-b7e6-07bd8448b124. {{(pid=86614) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Creating volume glance metadata for volume ff02fffd-e3ae-4a42-b7e6-07bd8448b124 backed by image 2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858 with: {'image_id': '2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'image_name': 'tempest-scenario-img--1988596702', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86614) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a9882f-95a9-4e26-ac10-0440fb8aa3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124', 'volume_size': 1, 'image_id': '2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1988596702', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84432e6df34244ef8e2d625b08dee6d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858', 'created_at': datetime.datetime(2026, 6, 3, 12, 47, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 47, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ff2e642-e6ff-4adb-90fa-aeeb8c4c0858/file', 'properties': {}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012aec62-b6ea-4369-a44b-e253edbea3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:23 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Volume volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 (ff02fffd-e3ae-4a42-b7e6-07bd8448b124): created successfully Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012aec62-b6ea-4369-a44b-e253edbea3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Flow 'volume_create_manager' (88404c6c-d2d4-4eb7-8d2a-b2278b287573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:48:23 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-400bd8b7-3e14-4299-8bb4-00aba362183b tempest-TestInstancesWithCinderVolumes-745954434 None] Created volume successfully. Jun 03 14:48:23 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-163e39a2-1670-4165-8b97-fbe43295deb0 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b" returned: 0 in 0.989s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:23 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b is being set with open permissions: ugo+rw Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:23 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b Jun 03 14:48:23 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:23 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869" returned: 0 in 0.952s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:23 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869 Jun 03 14:48:23 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:24 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b" returned: 0 in 0.696s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:24 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.info Jun 03 14:48:24 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:24 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-57a7df11-6324-41c4-845a-35856e939869" returned: 0 in 0.787s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Lock "cinder-quobyte-57a7df11-6324-41c4-845a-35856e939869" released by "delete_volume" :: held 1.808s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Created reservations ['5c3b17f5-64d5-42a2-a6e9-52f8a3bc7b5f', '357d35c8-c062-475c-99c3-9e44a8b158e0', '59dc1ad6-148c-4d07-958e-539074d7ab03', '71da25e5-462f-4880-bb9c-e3c9c086188e'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:24 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:48:24 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:24 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.info" returned: 0 in 0.754s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:24 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.info is being set with open permissions: ugo+rw Jun 03 14:48:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:24 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.info Jun 03 14:48:24 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:25 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.047s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:25 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:48:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Deleted volume successfully. Jun 03 14:48:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2df4680a-419d-4957-80af-b74e1b64e214 tempest-ServerRescueNegativeTestJSON-1857363226 None] Lock "cinder-57a7df11-6324-41c4-845a-35856e939869-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:25 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.info" returned: 0 in 1.057s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.343s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-322a2e4d-eec0-4f07-8c52-300e5ae40d72 req-7f85c198-0fce-4326-bf9f-7dac3441dc14 tempest-VolumesSnapshotsTestJSON-28270479 None] Create snapshot completed successfully Jun 03 14:48:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Acquiring lock "cinder-924ea701-2fbc-485f-98c7-dc56a6fa653b-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "cinder-924ea701-2fbc-485f-98c7-dc56a6fa653b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Acquiring lock "cinder-quobyte-163e39a2-1670-4165-8b97-fbe43295deb0" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "cinder-quobyte-163e39a2-1670-4165-8b97-fbe43295deb0" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Acquiring lock "cinder-quobyte-924ea701-2fbc-485f-98c7-dc56a6fa653b" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "cinder-quobyte-924ea701-2fbc-485f-98c7-dc56a6fa653b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Deleting offline snapshot 924ea701-2fbc-485f-98c7-dc56a6fa653b of volume 163e39a2-1670-4165-8b97-fbe43295deb0 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:48:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] snapshot_file for this snap is: volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:48:27 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8cc716-5e92-451b-ad76-51538a8a534f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:28 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b Jun 03 14:48:28 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:29 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b" returned: 0 in 1.358s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-163e39a2-1670-4165-8b97-fbe43295deb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:48:29 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1e01c5-f8f3-4bbf-9477-6dd88083fc53]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:29 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 Jun 03 14:48:29 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:30 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0" returned: 0 in 1.054s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:30 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b Jun 03 14:48:30 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:31 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b" returned: 0 in 1.033s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:31 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b Jun 03 14:48:31 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:32 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0.924ea701-2fbc-485f-98c7-dc56a6fa653b" returned: 0 in 1.073s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "cinder-quobyte-924ea701-2fbc-485f-98c7-dc56a6fa653b" released by "_delete_snapshot" :: held 4.712s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "cinder-quobyte-163e39a2-1670-4165-8b97-fbe43295deb0" released by "delete_snapshot" :: held 4.762s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-9c6375dd-542b-494e-89d2-7d17dadc9d6c req-b9500a74-654c-476a-bde0-4c6591a2e398 tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-9c6375dd-542b-494e-89d2-7d17dadc9d6c req-b9500a74-654c-476a-bde0-4c6591a2e398 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:32 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d19d25-4087-4a0d-a9c2-869ca476e5bb]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9c6375dd-542b-494e-89d2-7d17dadc9d6c req-b9500a74-654c-476a-bde0-4c6591a2e398 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:32 devstack cinder-volume[86614]: DEBUG cinder.quota [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Created reservations ['efe8c19e-c1d5-47dc-a7ae-fb468fc29fb9', '1235c3cc-7e8a-4a6f-905f-600cb7b2732a', 'c9cd3d63-d04a-4a97-8737-70e9ceb4fb15', '1792e4e5-4d48-4b4e-a040-2352d8022d97'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:48:32 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Delete snapshot completed successfully. Jun 03 14:48:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-9351987e-6fc4-4062-b0cf-eef6f67e00a3 req-9930ed51-51c9-4fe0-b1af-9668bf85683f tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "cinder-924ea701-2fbc-485f-98c7-dc56a6fa653b-delete_snapshot" released by "delete_snapshot" :: held 5.082s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:32 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 Jun 03 14:48:32 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:33 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9c6375dd-542b-494e-89d2-7d17dadc9d6c req-b9500a74-654c-476a-bde0-4c6591a2e398 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" returned: 0 in 1.143s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9c6375dd-542b-494e-89d2-7d17dadc9d6c req-b9500a74-654c-476a-bde0-4c6591a2e398 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Acquiring lock "cinder-163e39a2-1670-4165-8b97-fbe43295deb0-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "cinder-163e39a2-1670-4165-8b97-fbe43295deb0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:33 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 Jun 03 14:48:33 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Acquiring lock "cinder-quobyte-163e39a2-1670-4165-8b97-fbe43295deb0" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "cinder-quobyte-163e39a2-1670-4165-8b97-fbe43295deb0" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:34 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[6458b74b-29d3-48ce-aee4-552516f9be05]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:34 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 Jun 03 14:48:34 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:34 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9c6375dd-542b-494e-89d2-7d17dadc9d6c req-b9500a74-654c-476a-bde0-4c6591a2e398 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" returned: 1 in 0.930s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9c6375dd-542b-494e-89d2-7d17dadc9d6c req-b9500a74-654c-476a-bde0-4c6591a2e398 tempest-TestInstancesWithCinderVolumes-745954434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:48:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-9c6375dd-542b-494e-89d2-7d17dadc9d6c req-b9500a74-654c-476a-bde0-4c6591a2e398 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.153s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-9c6375dd-542b-494e-89d2-7d17dadc9d6c req-b9500a74-654c-476a-bde0-4c6591a2e398 tempest-TestInstancesWithCinderVolumes-745954434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7287347e-ffde-4c60-8263-2a3e61fd261b', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:48:34 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-9c6375dd-542b-494e-89d2-7d17dadc9d6c req-b9500a74-654c-476a-bde0-4c6591a2e398 tempest-TestInstancesWithCinderVolumes-745954434 None] attachment_update completed successfully. Jun 03 14:48:35 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0" returned: 0 in 1.124s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:35 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0 Jun 03 14:48:35 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:35 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-163e39a2-1670-4165-8b97-fbe43295deb0" returned: 0 in 0.702s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "cinder-quobyte-163e39a2-1670-4165-8b97-fbe43295deb0" released by "delete_volume" :: held 1.924s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:35 devstack cinder-volume[86614]: DEBUG cinder.quota [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Created reservations ['387732d2-21b0-4f48-a3cf-35d6278fc460', 'f58dbae5-331b-4ea6-9032-015bcb380164', '2c99b31b-4018-43db-8fe9-4b761a5001a1', '676cb368-9c56-4d35-91a3-8d053c48f830'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:48:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:48:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:48:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:36 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:48:36 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:37 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.224s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:37 devstack cinder-volume[86614]: DEBUG cinder.manager [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:48:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Deleted volume successfully. Jun 03 14:48:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-504ca4ec-2e9b-4254-a1fd-bd4d486a83cf req-a28fa66d-ccb1-4ec4-a158-24682e078ec1 tempest-VolumesSnapshotsTestJSON-28270479 None] Lock "cinder-163e39a2-1670-4165-8b97-fbe43295deb0-delete_volume" released by "delete_volume" :: held 3.626s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d041633d-4c24-46fb-9b1a-7b19bb068b59 tempest-VolumesActionsTest-1306905526 None] Acquiring lock "cinder-83d23d9b-653c-4385-aead-278f326ed407" by "attach_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d041633d-4c24-46fb-9b1a-7b19bb068b59 tempest-VolumesActionsTest-1306905526 None] Lock "cinder-83d23d9b-653c-4385-aead-278f326ed407" acquired by "attach_volume" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d041633d-4c24-46fb-9b1a-7b19bb068b59 tempest-VolumesActionsTest-1306905526 None] Attaching volume 83d23d9b-653c-4385-aead-278f326ed407 to instance 1faa60b3-74db-4e18-b9cf-2690e13ce986 at mountpoint /dev/vdb on host None. Jun 03 14:48:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d041633d-4c24-46fb-9b1a-7b19bb068b59 tempest-VolumesActionsTest-1306905526 None] Attach volume completed successfully. Jun 03 14:48:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d041633d-4c24-46fb-9b1a-7b19bb068b59 tempest-VolumesActionsTest-1306905526 None] Lock "cinder-83d23d9b-653c-4385-aead-278f326ed407" released by "attach_volume" :: held 0.126s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b8f1e673-2f26-42df-b837-14b46da5f276 tempest-VolumesActionsTest-1306905526 None] Acquiring lock "cinder-83d23d9b-653c-4385-aead-278f326ed407-detach_volume" by "detach_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:48:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b8f1e673-2f26-42df-b837-14b46da5f276 tempest-VolumesActionsTest-1306905526 None] Lock "cinder-83d23d9b-653c-4385-aead-278f326ed407-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:48:40 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b8f1e673-2f26-42df-b837-14b46da5f276 tempest-VolumesActionsTest-1306905526 None] Detaching volume 83d23d9b-653c-4385-aead-278f326ed407 from instance 1faa60b3-74db-4e18-b9cf-2690e13ce986. Jun 03 14:48:40 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b8f1e673-2f26-42df-b837-14b46da5f276 tempest-VolumesActionsTest-1306905526 None] Detach volume completed successfully. Jun 03 14:48:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b8f1e673-2f26-42df-b837-14b46da5f276 tempest-VolumesActionsTest-1306905526 None] Lock "cinder-83d23d9b-653c-4385-aead-278f326ed407-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:48:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f0833ff7-eeb6-4171-8f90-e2b271a81bcf tempest-GroupSnapshotsTest-611653072 None] Group tempest-GroupSnapshotsTest-Group-1913256981: creating Jun 03 14:48:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f0833ff7-eeb6-4171-8f90-e2b271a81bcf tempest-GroupSnapshotsTest-611653072 None] Group tempest-GroupSnapshotsTest-Group-1913256981: created successfully Jun 03 14:48:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f0833ff7-eeb6-4171-8f90-e2b271a81bcf tempest-GroupSnapshotsTest-611653072 None] Create group completed successfully. Jun 03 14:48:45 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:48:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Flow 'volume_create_manager' (28c026be-fcd8-4ef1-9f35-7a4bfe4319b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:48:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be20524b-6986-4d4c-ac43-f70d954df4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be20524b-6986-4d4c-ac43-f70d954df4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1800883440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1aef322-02ff-43b1-8621-acd92743624e,host='devstack@QuobyteHD#QuobyteHD',id=cb67125a-c6c8-4ac7-b781-8a5b0b3f983f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705760f4c6154bc4bae20b48ba559795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:48:46Z,use_quota=True,user_id='755ef5ba4078474d837bd99eaf790cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b11c4234-a4ca-48c0-ac78-fd8f32177487),volume_type_id=b11c4234-a4ca-48c0-ac78-fd8f32177487)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1aee0f-ac32-42f9-8eb8-5fd657088c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1aee0f-ac32-42f9-8eb8-5fd657088c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2357b75-12d4-4d67-bd69-4eb3b9fe73ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2357b75-12d4-4d67-bd69-4eb3b9fe73ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb67125a-c6c8-4ac7-b781-8a5b0b3f983f', 'volume_name': 'volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8896706-709d-4604-b610-58a618a412aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8896706-709d-4604-b610-58a618a412aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185e5447-2537-443d-a195-1000ac70697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:46 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Volume cb67125a-c6c8-4ac7-b781-8a5b0b3f983f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f', 'volume_size': 1} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1aef322-02ff-43b1-8621-acd92743624e,created_at=2026-06-03T12:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1800883440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1aef322-02ff-43b1-8621-acd92743624e,host='devstack@QuobyteHD#QuobyteHD',id=cb67125a-c6c8-4ac7-b781-8a5b0b3f983f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705760f4c6154bc4bae20b48ba559795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:48:46Z,use_quota=True,user_id='755ef5ba4078474d837bd99eaf790cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b11c4234-a4ca-48c0-ac78-fd8f32177487),volume_type_id=b11c4234-a4ca-48c0-ac78-fd8f32177487)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Creating volume cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:48:46 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:48:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:46 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f 1073741824 Jun 03 14:48:46 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f 1073741824" returned: 0 in 1.107s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:47 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:47 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f Jun 03 14:48:47 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:48 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" returned: 0 in 0.863s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:48:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185e5447-2537-443d-a195-1000ac70697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10aceef-7f40-4f10-a39e-124c43e90a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:48:48 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Volume volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f (cb67125a-c6c8-4ac7-b781-8a5b0b3f983f): created successfully Jun 03 14:48:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10aceef-7f40-4f10-a39e-124c43e90a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:48:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Flow 'volume_create_manager' (28c026be-fcd8-4ef1-9f35-7a4bfe4319b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:48:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1b68a3d7-2177-422f-8dbe-ae4effc4ecc4 tempest-GroupSnapshotsTest-611653072 None] Created volume successfully. Jun 03 14:48:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] GroupSnapshot 57a51c03-c845-412f-a632-8b3a9b36f79a: creating. Jun 03 14:48:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Group snapshot 57a51c03-c845-412f-a632-8b3a9b36f79a: creating. {{(pid=86614) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 03 14:48:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:49 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Creating offline snapshot 36e51964-27c0-4992-9d96-c04295c87c64 of volume cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:48:49 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fe4364-6b1f-4266-9ab7-5e9463085318]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:49 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f Jun 03 14:48:49 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:50 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" returned: 0 in 1.520s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:50 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 1G Jun 03 14:48:50 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:52 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 1G" returned: 0 in 1.375s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:52 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 Jun 03 14:48:52 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:53 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64" returned: 0 in 1.266s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:53 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:48:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:53 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 Jun 03 14:48:53 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:48:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:48:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:48:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:48:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:53 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:48:53 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:54 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64" returned: 0 in 1.221s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:54 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.info Jun 03 14:48:54 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:55 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.468s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:55 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:48:55 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.info" returned: 0 in 0.905s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:55 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:48:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:55 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.info Jun 03 14:48:55 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:56 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.info" returned: 0 in 1.102s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.582s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:48:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.576s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:48:56 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[41219b73-00b5-4851-b988-e52bdb27ba4f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8c3c6ec3-2302-4b44-8575-5e74f97ee1b0 tempest-GroupSnapshotsTest-611653072 None] group_snapshot 57a51c03-c845-412f-a632-8b3a9b36f79a: created successfully Jun 03 14:48:56 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 Jun 03 14:48:56 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:57 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407" returned: 0 in 0.836s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:57 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4135f393-ab6f-4187-931f-598b9ba5e477]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:48:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:57 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 Jun 03 14:48:57 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:58 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Jun 03 14:48:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407" returned: 0 in 0.845s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:48:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.9a4006f4-e410-4329-b661-035140800633r9uwwt7j.img {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:48:58 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.9a4006f4-e410-4329-b661-035140800633r9uwwt7j.img Jun 03 14:48:58 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:48:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:04 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.9a4006f4-e410-4329-b661-035140800633r9uwwt7j.img" returned: 0 in 5.799s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:04 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e221ec9-104b-41ff-9673-7af7b4a697b4]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:04 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 Jun 03 14:49:04 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:05 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407" returned: 0 in 0.918s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:05 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.9a4006f4-e410-4329-b661-035140800633r9uwwt7j.img {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:49:05 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Converted 1024.00 MB image at 176.57 MB/s Jun 03 14:49:05 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=54,cinder:SELECT=56,cinder:INSERT=19,cinder:DELETE=3 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:49:05 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=68,cinder:DELETE=6,cinder:UPDATE=44,cinder:INSERT=13 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:49:05 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] 9a4006f4-e410-4329-b661-035140800633 was raw, no need to convert to raw {{(pid=86614) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 03 14:49:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-d629f5d8-9439-4aeb-ab97-7278f64e3941 req-0baf8a3f-d7dd-482f-98c7-e6c7a01e105b tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:23 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=1 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:49:23 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=1 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.899s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Uploaded volume to glance image-id: 9a4006f4-e410-4329-b661-035140800633. {{(pid=86614) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 27.707s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-36e51964-27c0-4992-9d96-c04295c87c64-ac012496-5de4-4cbe-903e-e5a8e599f552" by "_create_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-36e51964-27c0-4992-9d96-c04295c87c64-ac012496-5de4-4cbe-903e-e5a8e599f552" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Creating volume ac012496-5de4-4cbe-903e-e5a8e599f552 from snapshot 36e51964-27c0-4992-9d96-c04295c87c64 {{(pid=86614) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-ac012496-5de4-4cbe-903e-e5a8e599f552" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:49:26 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e14daa61-b4d9-4e96-b2bd-01b4a2e835ac tempest-VolumesActionsTest-1306905526 None] Copy volume to image completed successfully. Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-ac012496-5de4-4cbe-903e-e5a8e599f552" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] snapshot: 36e51964-27c0-4992-9d96-c04295c87c64, volume: ac012496-5de4-4cbe-903e-e5a8e599f552, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a402eac-7f1d-4e21-bfad-0b173def00d7]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:26 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 Jun 03 14:49:26 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:27 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64" returned: 0 in 0.951s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:49:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 14:49:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 14:49:27 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e4d317-7d01-4c0d-9c1c-69777092250b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:27 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f Jun 03 14:49:27 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:28 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" returned: 0 in 0.903s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:28 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 14:49:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:28 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 Jun 03 14:49:28 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:34 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552" returned: 0 in 6.303s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:34 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8928943e-f5f4-49fc-bcf4-9e019f35e612]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:35 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f Jun 03 14:49:35 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:35 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" returned: 0 in 0.909s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:35 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:49:35 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Converted 1024.00 MB image at 162.43 MB/s Jun 03 14:49:35 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:49:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:35 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 Jun 03 14:49:35 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:36 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552" returned: 0 in 0.590s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-ac012496-5de4-4cbe-903e-e5a8e599f552" released by "_copy_volume_from_snapshot" :: held 9.822s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:49:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-36e51964-27c0-4992-9d96-c04295c87c64-ac012496-5de4-4cbe-903e-e5a8e599f552" released by "_create_volume_from_snapshot" :: held 9.853s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:49:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.881s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-d629f5d8-9439-4aeb-ab97-7278f64e3941 req-0baf8a3f-d7dd-482f-98c7-e6c7a01e105b tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 23.119s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4271f2ef-18ab-48ce-b553-1f03b54344c7]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-d629f5d8-9439-4aeb-ab97-7278f64e3941 req-0baf8a3f-d7dd-482f-98c7-e6c7a01e105b tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:36 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d2017eab-3bdd-458e-94d8-a83cbb744427 tempest-GroupSnapshotsTest-611653072 None] Create group from source-snapshot-57a51c03-c845-412f-a632-8b3a9b36f79a completed successfully. Jun 03 14:49:36 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 Jun 03 14:49:36 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-ac012496-5de4-4cbe-903e-e5a8e599f552" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-ac012496-5de4-4cbe-903e-e5a8e599f552" acquired by "delete_volume" :: waited 0.028s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f8e0c8-0397-4f09-8fbe-7ce18de35d96]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:37 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 Jun 03 14:49:37 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:37 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-d629f5d8-9439-4aeb-ab97-7278f64e3941 req-0baf8a3f-d7dd-482f-98c7-e6c7a01e105b tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1" returned: 0 in 0.812s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-d629f5d8-9439-4aeb-ab97-7278f64e3941 req-0baf8a3f-d7dd-482f-98c7-e6c7a01e105b tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.836s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 9.332s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20b1f22-f964-4355-a986-091e45ab7511]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-d629f5d8-9439-4aeb-ab97-7278f64e3941 req-0baf8a3f-d7dd-482f-98c7-e6c7a01e105b tempest-TestInstancesWithCinderVolumes-745954434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-187a7240-c8f6-466e-b72a-04571f7413b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b569cf25-c868-4fe2-8408-6518ada3b15f', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:49:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-d629f5d8-9439-4aeb-ab97-7278f64e3941 req-0baf8a3f-d7dd-482f-98c7-e6c7a01e105b tempest-TestInstancesWithCinderVolumes-745954434 None] attachment_update completed successfully. Jun 03 14:49:37 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 Jun 03 14:49:37 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:37 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552" returned: 0 in 0.815s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:38 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552 Jun 03 14:49:38 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:38 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407" returned: 0 in 0.774s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[0726d954-f111-40aa-9b00-42700f388c39]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:38 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 Jun 03 14:49:38 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:38 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ac012496-5de4-4cbe-903e-e5a8e599f552" returned: 0 in 0.635s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-ac012496-5de4-4cbe-903e-e5a8e599f552" released by "delete_volume" :: held 1.513s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Created reservations ['6e866701-4985-46fd-ac6e-4d908d36874b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:49:38 devstack cinder-volume[86614]: WARNING cinder.quota [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-466990445 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-466990445, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:49:38 devstack cinder-volume[86614]: WARNING cinder.quota [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-466990445 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-466990445, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Created reservations ['a9ecd37b-d95c-4e7a-8b0c-f195fab6fd76', '8ebf9376-e308-4abf-b517-2b8837a729e1', 'f7934134-fb57-4df2-a304-88b12f45fe0b', '96e4bf94-fae6-4053-9ad5-8a95ae8b7a3a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:38 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407" returned: 0 in 0.767s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:38 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:49:38 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:38 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img Jun 03 14:49:38 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] group_snapshot 57a51c03-c845-412f-a632-8b3a9b36f79a: deleting Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] group_snapshot 57a51c03-c845-412f-a632-8b3a9b36f79a: deleting {{(pid=86614) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-36e51964-27c0-4992-9d96-c04295c87c64" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:49:39 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-36e51964-27c0-4992-9d96-c04295c87c64" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Deleting offline snapshot 36e51964-27c0-4992-9d96-c04295c87c64 of volume cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] snapshot_file for this snap is: volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.631s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:49:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-afcdceae-296a-4139-85e3-f7cbedea7c97 tempest-GroupSnapshotsTest-611653072 None] Delete group completed successfully. Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[c954c9f0-2c64-4e46-b628-e90a6eb8bc1c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:39 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 Jun 03 14:49:39 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:41 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64" returned: 0 in 1.960s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:49:41 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[be219b71-a1fb-46f6-a2a7-4e7d591bc7da]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:41 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f Jun 03 14:49:41 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:43 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" returned: 0 in 2.067s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:43 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 Jun 03 14:49:43 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:44 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img" returned: 0 in 5.150s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:44 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd04843-eeda-4ca0-9e44-0325a69cd8b9]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:44 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 Jun 03 14:49:44 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:44 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64" returned: 0 in 0.897s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:44 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64 Jun 03 14:49:44 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:45 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407" returned: 0 in 0.981s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:49:45 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Converted 1024.00 MB image at 198.77 MB/s Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] 24c27205-a84b-48c1-b9fd-8216e15cbb80 was raw, converting to qcow2 {{(pid=86614) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce79267-6b49-4585-8cab-a753a5b1a2e9]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:45 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img Jun 03 14:49:45 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:45 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f.36e51964-27c0-4992-9d96-c04295c87c64" returned: 0 in 0.712s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-36e51964-27c0-4992-9d96-c04295c87c64" released by "_delete_snapshot" :: held 5.818s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" released by "delete_snapshot" :: held 5.844s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:49:45 devstack cinder-volume[86614]: WARNING cinder.quota [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-466990445 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-466990445, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] Created reservations ['fe08a421-2a5e-47ad-84ae-926f56340127', '713fc3f7-72be-4804-8da4-83c316115e20', '5128c3d8-d023-412e-931d-2f961f9efee8', '3c1bfd7a-9ef6-466e-8db5-f245efb8aa81'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:49:45 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-bc6d73a1-750a-456d-8863-3d4c23e1cd86 tempest-GroupSnapshotsTest-611653072 None] group_snapshot 57a51c03-c845-412f-a632-8b3a9b36f79a: deleted successfully Jun 03 14:49:45 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img" returned: 0 in 0.696s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-22b0714f-c4ea-49a5-9635-2827adfdbb41 req-70bd28de-4287-4096-99fa-846dfca78833 tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:45 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img Jun 03 14:49:45 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:46 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:49:46 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:49:46 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc67422-6950-47e0-bbfc-3dacf845456b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:46 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f Jun 03 14:49:46 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:46 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img" returned: 1 in 0.682s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:49:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img /opt/stack/data/cinder/conversion/vol_upload_ioas9is6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:46 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img /opt/stack/data/cinder/conversion/vol_upload_ioas9is6 Jun 03 14:49:46 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:47 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" returned: 0 in 0.699s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:47 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f Jun 03 14:49:47 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:47 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img /opt/stack/data/cinder/conversion/vol_upload_ioas9is6" returned: 0 in 0.590s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Image conversion details: src /opt/stack/data/cinder/conversion/83d23d9b-653c-4385-aead-278f326ed407.temp_image.24c27205-a84b-48c1-b9fd-8216e15cbb80eg2cfxb8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ioas9is6 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:49:47 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[124c6238-942e-4943-af1f-ba87db5638bb]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ioas9is6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:47 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ioas9is6 Jun 03 14:49:47 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:47 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" returned: 0 in 0.586s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-cb67125a-c6c8-4ac7-b781-8a5b0b3f983f" released by "delete_volume" :: held 1.352s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Created reservations ['5b1ef908-5549-4166-8208-b44d177607f5'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:49:47 devstack cinder-volume[86614]: WARNING cinder.db.sqlalchemy.api [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-466990445'] Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Created reservations ['e488a9a4-64cc-41c4-9211-2c4574b25330', '118a950d-051f-401c-badb-be93c8a9a4dc', 'd507cd5e-aae9-4092-b51c-5fa9d37df3d9', 'f717cefb-2b77-448c-b268-00492a966eea'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:49:47 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ioas9is6" returned: 0 in 0.728s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:47 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:49:47 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Flow 'volume_create_manager' (ea3fddf6-bf8a-45a2-aa9a-1de2cf44623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e2f0dd-d45d-4ffc-9ff1-e2e6f35a594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e2f0dd-d45d-4ffc-9ff1-e2e6f35a594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-146175054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289166f5-8378-4469-95d5-a30f978ce116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe63bdd834684039b19fd6e49d40f1da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:49:48Z,use_quota=True,user_id='097bf913b6c14abfb4c838d10b891c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30002add-20cd-40ef-b17a-be24ffe0e52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30002add-20cd-40ef-b17a-be24ffe0e52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50550c4c-e329-450d-8ac4-402d02620493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50550c4c-e329-450d-8ac4-402d02620493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '289166f5-8378-4469-95d5-a30f978ce116', 'volume_name': 'volume-289166f5-8378-4469-95d5-a30f978ce116', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f75756-77d1-4e98-ab2b-1380718c4f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f75756-77d1-4e98-ab2b-1380718c4f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad9a3ca-c5d4-4ffd-b19c-108386c52553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:48 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Volume 289166f5-8378-4469-95d5-a30f978ce116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-289166f5-8378-4469-95d5-a30f978ce116', 'volume_size': 1} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:48 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.692s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:48 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:49:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a4fe97fe-dd2c-4106-a05e-2709f032d5b5 tempest-GroupSnapshotsTest-611653072 None] Delete group completed successfully. Jun 03 14:49:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e50f49c2-32ed-487b-8613-e2c00a6aaeef tempest-GroupSnapshotsTest-611653072 None] Group tempest-GroupSnapshotsTest-Group-1195812849: creating Jun 03 14:49:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e50f49c2-32ed-487b-8613-e2c00a6aaeef tempest-GroupSnapshotsTest-611653072 None] Group tempest-GroupSnapshotsTest-Group-1195812849: created successfully Jun 03 14:49:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e50f49c2-32ed-487b-8613-e2c00a6aaeef tempest-GroupSnapshotsTest-611653072 None] Create group completed successfully. Jun 03 14:49:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.918s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Uploaded volume to glance image-id: 24c27205-a84b-48c1-b9fd-8216e15cbb80. {{(pid=86614) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jun 03 14:49:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-22b0714f-c4ea-49a5-9635-2827adfdbb41 req-70bd28de-4287-4096-99fa-846dfca78833 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.420s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:49 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a413892f-faff-4a77-8102-615747846295]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-22b0714f-c4ea-49a5-9635-2827adfdbb41 req-70bd28de-4287-4096-99fa-846dfca78833 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:49 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-2c203989-600e-4240-8ad9-23fa5d818387 tempest-VolumesActionsTest-1306905526 None] Copy volume to image completed successfully. Jun 03 14:49:49 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 Jun 03 14:49:49 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:50 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-22b0714f-c4ea-49a5-9635-2827adfdbb41 req-70bd28de-4287-4096-99fa-846dfca78833 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74" returned: 0 in 0.743s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-22b0714f-c4ea-49a5-9635-2827adfdbb41 req-70bd28de-4287-4096-99fa-846dfca78833 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.761s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.474s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-146175054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289166f5-8378-4469-95d5-a30f978ce116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe63bdd834684039b19fd6e49d40f1da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:49:48Z,use_quota=True,user_id='097bf913b6c14abfb4c838d10b891c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Creating volume 289166f5-8378-4469-95d5-a30f978ce116 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:49:50 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Acquiring lock "cinder-83d23d9b-653c-4385-aead-278f326ed407-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:49:50 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 1073741824 Jun 03 14:49:50 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Lock "cinder-83d23d9b-653c-4385-aead-278f326ed407-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-22b0714f-c4ea-49a5-9635-2827adfdbb41 req-70bd28de-4287-4096-99fa-846dfca78833 tempest-TestInstancesWithCinderVolumes-745954434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-79201db4-bf76-4dae-b8cc-9eecbeddee74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebb54df2-1a55-4828-9dcb-5575ecbe75c5', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Acquiring lock "cinder-quobyte-83d23d9b-653c-4385-aead-278f326ed407" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Lock "cinder-quobyte-83d23d9b-653c-4385-aead-278f326ed407" acquired by "delete_volume" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b052128e-c75f-45dd-bfa1-844975fb61f7]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:50 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-22b0714f-c4ea-49a5-9635-2827adfdbb41 req-70bd28de-4287-4096-99fa-846dfca78833 tempest-TestInstancesWithCinderVolumes-745954434 None] attachment_update completed successfully. Jun 03 14:49:50 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 Jun 03 14:49:50 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Flow 'volume_create_manager' (fd6a7e78-a8cc-45f0-bf3c-f0f86d72f037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b68c915-a912-45cd-b70e-380fc430b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b68c915-a912-45cd-b70e-380fc430b891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1937151355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5f193e5-8790-4570-aea4-fc1e6c4bb9ed,host='devstack@QuobyteHD#QuobyteHD',id=daec5ef7-a3d9-4840-809a-b660b3e0ce3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705760f4c6154bc4bae20b48ba559795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:49:51Z,use_quota=True,user_id='755ef5ba4078474d837bd99eaf790cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4a3d570-c154-430f-aa73-6047c7e53472),volume_type_id=b4a3d570-c154-430f-aa73-6047c7e53472)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de64c027-7fc0-4021-9f3c-c0ffcc795100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de64c027-7fc0-4021-9f3c-c0ffcc795100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3909a202-da36-4ac9-9667-6e7e9c65c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3909a202-da36-4ac9-9667-6e7e9c65c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daec5ef7-a3d9-4840-809a-b660b3e0ce3d', 'volume_name': 'volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de47d5d-05bd-4a8e-a66e-302f3c21ddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de47d5d-05bd-4a8e-a66e-302f3c21ddf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c41b446-1af7-4a46-8f9e-d984cd7f99f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:50 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Volume daec5ef7-a3d9-4840-809a-b660b3e0ce3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d', 'volume_size': 1} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:50 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 1073741824" returned: 0 in 0.875s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:50 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 Jun 03 14:49:50 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:51 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407" returned: 0 in 0.827s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:51 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407 Jun 03 14:49:51 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:51 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116" returned: 0 in 0.619s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5f193e5-8790-4570-aea4-fc1e6c4bb9ed,created_at=2026-06-03T12:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1937151355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5f193e5-8790-4570-aea4-fc1e6c4bb9ed,host='devstack@QuobyteHD#QuobyteHD',id=daec5ef7-a3d9-4840-809a-b660b3e0ce3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705760f4c6154bc4bae20b48ba559795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:49:51Z,use_quota=True,user_id='755ef5ba4078474d837bd99eaf790cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4a3d570-c154-430f-aa73-6047c7e53472),volume_type_id=b4a3d570-c154-430f-aa73-6047c7e53472)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Creating volume daec5ef7-a3d9-4840-809a-b660b3e0ce3d {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:49:51 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:51 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d 1073741824 Jun 03 14:49:51 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad9a3ca-c5d4-4ffd-b19c-108386c52553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-289166f5-8378-4469-95d5-a30f978ce116', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0877b1ad-4955-4f2b-9911-3f996c31e303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:51 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Volume volume-289166f5-8378-4469-95d5-a30f978ce116 (289166f5-8378-4469-95d5-a30f978ce116): created successfully Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0877b1ad-4955-4f2b-9911-3f996c31e303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Flow 'volume_create_manager' (ea3fddf6-bf8a-45a2-aa9a-1de2cf44623e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:49:51 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-83d23d9b-653c-4385-aead-278f326ed407" returned: 0 in 0.649s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:51 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-6abdb8b5-51ca-43f5-b816-949ef7fece30 tempest-AttachVolumeShelveTestJSON-149926842 None] Created volume successfully. Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Lock "cinder-quobyte-83d23d9b-653c-4385-aead-278f326ed407" released by "delete_volume" :: held 1.523s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Created reservations ['c416fe83-f2d5-4566-95cb-7be2a231fe41', '799fd347-731e-4ca3-85ef-0f45518aff47', 'e68e9609-75b8-4d8d-b60d-5aea27b3d5d2', '6796df59-4a53-472b-a246-26ffc642b00b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:51 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:49:51 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:52 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d 1073741824" returned: 0 in 0.836s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:52 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.632s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:52 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:49:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:52 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Deleted volume successfully. Jun 03 14:49:52 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d Jun 03 14:49:52 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dd12ea62-4035-40fa-a4fb-e56253076f12 tempest-VolumesActionsTest-1306905526 None] Lock "cinder-83d23d9b-653c-4385-aead-278f326ed407-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:49:53 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" returned: 0 in 0.693s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c41b446-1af7-4a46-8f9e-d984cd7f99f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9702f95c-f64d-408f-aee5-2ef1d13a8ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:53 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Volume volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d (daec5ef7-a3d9-4840-809a-b660b3e0ce3d): created successfully Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9702f95c-f64d-408f-aee5-2ef1d13a8ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Flow 'volume_create_manager' (fd6a7e78-a8cc-45f0-bf3c-f0f86d72f037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:49:53 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4d377c6f-7dfb-460b-bc85-baec05da56dd tempest-GroupSnapshotsTest-611653072 None] Created volume successfully. Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:53 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:49:53 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:54 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.842s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Flow 'volume_create_manager' (23119b83-c67b-48f9-b3ce-0e35d2cfd795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f683da-68a3-4ef9-af28-9dc7d3bcdf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f683da-68a3-4ef9-af28-9dc7d3bcdf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1191117578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5f193e5-8790-4570-aea4-fc1e6c4bb9ed,host='devstack@QuobyteHD#QuobyteHD',id=52c7bd9e-29da-44d6-9331-ddfdd5a5cf47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705760f4c6154bc4bae20b48ba559795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:49:55Z,use_quota=True,user_id='755ef5ba4078474d837bd99eaf790cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4a3d570-c154-430f-aa73-6047c7e53472),volume_type_id=b4a3d570-c154-430f-aa73-6047c7e53472)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7903a2fc-d989-40d2-9f3b-bf32b30f5687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7903a2fc-d989-40d2-9f3b-bf32b30f5687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586cff73-19c4-48ab-8ccc-23c1bdfefe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586cff73-19c4-48ab-8ccc-23c1bdfefe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c7bd9e-29da-44d6-9331-ddfdd5a5cf47', 'volume_name': 'volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ffd67f-a6d8-41e3-9d4e-b9ba74c6d71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ffd67f-a6d8-41e3-9d4e-b9ba74c6d71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8870d6c-a869-4117-a309-4f8a70987ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:54 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Volume 52c7bd9e-29da-44d6-9331-ddfdd5a5cf47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47', 'volume_size': 1} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5f193e5-8790-4570-aea4-fc1e6c4bb9ed,created_at=2026-06-03T12:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1191117578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5f193e5-8790-4570-aea4-fc1e6c4bb9ed,host='devstack@QuobyteHD#QuobyteHD',id=52c7bd9e-29da-44d6-9331-ddfdd5a5cf47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705760f4c6154bc4bae20b48ba559795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:49:55Z,use_quota=True,user_id='755ef5ba4078474d837bd99eaf790cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4a3d570-c154-430f-aa73-6047c7e53472),volume_type_id=b4a3d570-c154-430f-aa73-6047c7e53472)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Creating volume 52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:49:54 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:49:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:54 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 1073741824 Jun 03 14:49:54 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:55 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 1073741824" returned: 0 in 1.085s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:55 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 Jun 03 14:49:55 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:56 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jun 03 14:49:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" returned: 0 in 0.753s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:49:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:49:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8870d6c-a869-4117-a309-4f8a70987ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e181365b-9374-4ef9-8c8d-8c0811f7ffb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:56 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Volume volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 (52c7bd9e-29da-44d6-9331-ddfdd5a5cf47): created successfully Jun 03 14:49:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e181365b-9374-4ef9-8c8d-8c0811f7ffb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Flow 'volume_create_manager' (23119b83-c67b-48f9-b3ce-0e35d2cfd795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:49:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-9689cee7-e281-42bc-a83d-e0d32f29ae82 tempest-GroupSnapshotsTest-611653072 None] Created volume successfully. Jun 03 14:49:57 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b2a68a28-a7b8-401c-a1b8-bda422a11576 tempest-GroupSnapshotsTest-611653072 None] Update group completed successfully. Jun 03 14:49:58 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-06a2352c-2b8a-41b4-9688-d8c22fb73639 tempest-GroupSnapshotsTest-611653072 None] Update group completed successfully. Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Flow 'volume_create_manager' (42da705a-8530-4a5f-a823-01cd9251685a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e7cc6a-4c96-4adf-848d-cf032515e551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e7cc6a-4c96-4adf-848d-cf032515e551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-869697477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165a31a7-b1f2-4c2b-b938-3235ef09e5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcd540df6888401fafc1f06ae0d5b0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:50:00Z,use_quota=True,user_id='901401d9d81c4290a846a2e4ac47bcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc49089-8ebc-4348-ae6c-b815efa2361c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc49089-8ebc-4348-ae6c-b815efa2361c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82837d4f-b7b9-49a7-8eaf-6d74e8e2abe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82837d4f-b7b9-49a7-8eaf-6d74e8e2abe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165a31a7-b1f2-4c2b-b938-3235ef09e5b7', 'volume_name': 'volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c1fe30-1ea9-4fa4-b260-1c0db593bca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c1fe30-1ea9-4fa4-b260-1c0db593bca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80606310-619a-4728-ae03-03fe39fb9cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:49:59 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Volume 165a31a7-b1f2-4c2b-b938-3235ef09e5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7', 'volume_size': 1} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-869697477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165a31a7-b1f2-4c2b-b938-3235ef09e5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcd540df6888401fafc1f06ae0d5b0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:50:00Z,use_quota=True,user_id='901401d9d81c4290a846a2e4ac47bcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Creating volume 165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:49:59 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:49:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:49:59 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 1073741824 Jun 03 14:49:59 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:49:59 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7dcf6b1b-495c-47ad-b486-f8f10c9ca08f tempest-GroupSnapshotsTest-611653072 None] Update group completed successfully. Jun 03 14:50:00 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-c8880145-2d17-41e1-9a79-b34801813926 req-3baa02fc-bb08-44a9-b6a0-ab060cb98818 tempest-TestInstancesWithCinderVolumes-745954434 None] Terminate volume connection completed successfully. Jun 03 14:50:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-c8880145-2d17-41e1-9a79-b34801813926 req-3baa02fc-bb08-44a9-b6a0-ab060cb98818 tempest-TestInstancesWithCinderVolumes-745954434 None] Deleting attachment b569cf25-c868-4fe2-8408-6518ada3b15f. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:50:00 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 1073741824" returned: 0 in 0.867s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:00 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 Jun 03 14:50:00 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:01 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-fae3fdfc-f863-4b50-b328-067be3c7bd28 tempest-GroupSnapshotsTest-611653072 None] Update group completed successfully. Jun 03 14:50:01 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7" returned: 0 in 0.687s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:50:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80606310-619a-4728-ae03-03fe39fb9cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364857f1-eb07-41cf-a26c-7f3af1f5d00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:01 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Volume volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 (165a31a7-b1f2-4c2b-b938-3235ef09e5b7): created successfully Jun 03 14:50:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364857f1-eb07-41cf-a26c-7f3af1f5d00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Flow 'volume_create_manager' (42da705a-8530-4a5f-a823-01cd9251685a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:50:01 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f9dc030c-5fab-45bc-9762-39825f09c803 tempest-VolumesCloneTest-265896852 None] Created volume successfully. Jun 03 14:50:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "cinder-187a7240-c8f6-466e-b72a-04571f7413b1-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-187a7240-c8f6-466e-b72a-04571f7413b1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "cinder-quobyte-187a7240-c8f6-466e-b72a-04571f7413b1" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-quobyte-187a7240-c8f6-466e-b72a-04571f7413b1" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d851a547-0624-4c3f-aacb-91546d4aa518]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:02 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 Jun 03 14:50:02 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Flow 'volume_create_manager' (66af134c-f5de-46ed-8e7d-96d26826fdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ea4e0f-5fd7-442b-b810-7e9e10700420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ea4e0f-5fd7-442b-b810-7e9e10700420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1543407020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48841e7f-b97f-4c04-b09b-4d93b7a8fa73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcd540df6888401fafc1f06ae0d5b0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:50:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=165a31a7-b1f2-4c2b-b938-3235ef09e5b7,status='creating',terminated_at=None,updated_at=2026-06-03T12:50:02Z,use_quota=True,user_id='901401d9d81c4290a846a2e4ac47bcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af30056e-bc3d-4325-9bc5-e03010d513ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af30056e-bc3d-4325-9bc5-e03010d513ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63048e2-1aa4-4c91-8a77-9203099b0043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63048e2-1aa4-4c91-8a77-9203099b0043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '48841e7f-b97f-4c04-b09b-4d93b7a8fa73', 'volume_name': 'volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73', 'volume_size': 2, 'source_volid': '165a31a7-b1f2-4c2b-b938-3235ef09e5b7', 'source_volstatus': 'available'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1a8f8c-fa4a-4ffd-b266-0ca210fcfaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1a8f8c-fa4a-4ffd-b266-0ca210fcfaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb740fc-9a11-4a75-99fb-a9786b0b7ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:02 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Volume 48841e7f-b97f-4c04-b09b-4d93b7a8fa73: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73', 'volume_size': 2, 'source_volid': '165a31a7-b1f2-4c2b-b938-3235ef09e5b7', 'source_volstatus': 'available'} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:02 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Cloning volume 165a31a7-b1f2-4c2b-b938-3235ef09e5b7 to volume 48841e7f-b97f-4c04-b09b-4d93b7a8fa73 Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Creating offline snapshot d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 of volume 165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede9d0ed-680f-4323-a929-01af4d6b9119]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:02 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] GroupSnapshot a50f0c25-e948-4095-b92d-069c73b551b1: creating. Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Group snapshot a50f0c25-e948-4095-b92d-069c73b551b1: creating. {{(pid=86614) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 03 14:50:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:02 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 Jun 03 14:50:02 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:03 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1" returned: 0 in 0.869s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:03 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1 Jun 03 14:50:03 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:03 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7" returned: 0 in 0.805s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:03 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 1G Jun 03 14:50:03 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:03 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-187a7240-c8f6-466e-b72a-04571f7413b1" returned: 0 in 0.700s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-quobyte-187a7240-c8f6-466e-b72a-04571f7413b1" released by "delete_volume" :: held 1.635s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:03 devstack cinder-volume[86614]: WARNING cinder.quota [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2121441503-1544229179 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2121441503-1544229179, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:03 devstack cinder-volume[86614]: WARNING cinder.quota [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2121441503-1544229179 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2121441503-1544229179, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Created reservations ['f53ac87d-25a1-41d3-879b-1e7becfb1662', '96c04b6b-5dd2-4acd-ad61-01fa88ebb496', '4da3ced5-5879-43d5-94a0-3aeea736ab3e', 'd8b4cf07-81bf-4d56-b03f-ff9e1abecc48'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:03 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:50:03 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:04 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 1G" returned: 0 in 0.908s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:04 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 Jun 03 14:50:04 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:04 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.660s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:04 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:50:04 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Deleted volume successfully. Jun 03 14:50:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3bbcde5b-bbb3-4e37-b078-41068948c48d tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-187a7240-c8f6-466e-b72a-04571f7413b1-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:05 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354" returned: 0 in 0.685s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:05 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 is being set with open permissions: ugo+rw Jun 03 14:50:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:05 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 Jun 03 14:50:05 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:05 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354" returned: 0 in 0.768s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:05 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.info Jun 03 14:50:05 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:06 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.info" returned: 0 in 0.613s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:06 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.info is being set with open permissions: ugo+rw Jun 03 14:50:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:06 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.info Jun 03 14:50:06 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:07 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.info" returned: 0 in 0.619s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Acquiring lock "cinder-quobyte-48841e7f-b97f-4c04-b09b-4d93b7a8fa73" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Lock "cinder-quobyte-48841e7f-b97f-4c04-b09b-4d93b7a8fa73" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] snapshot: d530f1e5-8a3e-4319-a8c1-c5cdd3e23354, volume: 48841e7f-b97f-4c04-b09b-4d93b7a8fa73, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e459ce-64b2-42d8-b349-b033a32cf06a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:07 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-2943a41c-c7fe-41e6-9451-3976c21d2646 req-ad4ab0bc-1ec3-4857-90cd-556f136ac227 tempest-TestInstancesWithCinderVolumes-745954434 None] Terminate volume connection completed successfully. Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-2943a41c-c7fe-41e6-9451-3976c21d2646 req-ad4ab0bc-1ec3-4857-90cd-556f136ac227 tempest-TestInstancesWithCinderVolumes-745954434 None] Deleting attachment ebb54df2-1a55-4828-9dcb-5575ecbe75c5. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:50:07 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 Jun 03 14:50:07 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:07 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354" returned: 0 in 0.716s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab199882-8e94-42df-81f9-3c1826d7566a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:07 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 Jun 03 14:50:08 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:08 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7" returned: 0 in 0.720s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:08 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 14:50:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:08 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 Jun 03 14:50:08 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "cinder-79201db4-bf76-4dae-b8cc-9eecbeddee74-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-79201db4-bf76-4dae-b8cc-9eecbeddee74-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "cinder-quobyte-79201db4-bf76-4dae-b8cc-9eecbeddee74" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-quobyte-79201db4-bf76-4dae-b8cc-9eecbeddee74" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:09 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8da352-8eb3-40a0-8359-af030749c568]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:09 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 Jun 03 14:50:09 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:10 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74" returned: 0 in 1.704s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:11 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74 Jun 03 14:50:11 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:12 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-79201db4-bf76-4dae-b8cc-9eecbeddee74" returned: 0 in 1.483s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-quobyte-79201db4-bf76-4dae-b8cc-9eecbeddee74" released by "delete_volume" :: held 3.259s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:12 devstack cinder-volume[86614]: WARNING cinder.quota [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-985412431-341024294 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-985412431-341024294, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:12 devstack cinder-volume[86614]: WARNING cinder.quota [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-985412431-341024294 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-985412431-341024294, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:12 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Created reservations ['b7cca6fa-d7f1-4f7f-87cd-6b05ed95363e', '5326ce89-dab4-42ca-afc5-4bdb0f249612', '3decffbe-41bf-4279-a0c7-add83f832c4e', 'c49b6ea8-c765-4d54-813e-6e9981cb6447'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:12 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:50:12 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:13 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.191s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:13 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:50:13 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Deleted volume successfully. Jun 03 14:50:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e396f125-c57d-48f3-91a1-8f1bfdeab8ff tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-79201db4-bf76-4dae-b8cc-9eecbeddee74-delete_volume" released by "delete_volume" :: held 4.853s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-b75f6695-2e21-4c29-b16f-e9ea7e59540c req-e8005898-63e6-4c66-a261-0a88a6d05a9a tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:15 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73" returned: 0 in 6.504s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:15 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd89214-3e07-48c4-b0c8-486e36e56f20]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:15 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 Jun 03 14:50:15 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:16 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7" returned: 0 in 0.870s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:50:16 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Converted 1024.00 MB image at 157.41 MB/s Jun 03 14:50:16 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 is being set with open permissions: ugo+rw Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:16 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 Jun 03 14:50:16 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:16 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73" returned: 0 in 0.750s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Lock "cinder-quobyte-48841e7f-b97f-4c04-b09b-4d93b7a8fa73" released by "_copy_volume_from_snapshot" :: held 9.671s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Acquiring lock "cinder-quobyte-d530f1e5-8a3e-4319-a8c1-c5cdd3e23354" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Lock "cinder-quobyte-d530f1e5-8a3e-4319-a8c1-c5cdd3e23354" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Deleting offline snapshot d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 of volume 165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] snapshot_file for this snap is: volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef63218-028a-41a1-a674-029a679e46e4]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:17 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 Jun 03 14:50:17 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:17 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354" returned: 0 in 0.890s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:50:17 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fbd1b3-453f-44ab-bfa8-637f60b7e2e8]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:17 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 Jun 03 14:50:17 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:18 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7" returned: 0 in 0.726s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:18 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 Jun 03 14:50:18 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:19 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354" returned: 0 in 0.711s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:19 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354 Jun 03 14:50:19 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:19 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-5bf7ab0d-62a1-495d-b1ba-193132d9675f req-e9998c29-4402-4fcd-9371-02f98be67a3d tempest-TestInstancesWithCinderVolumes-745954434 None] Terminate volume connection completed successfully. Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-5bf7ab0d-62a1-495d-b1ba-193132d9675f req-e9998c29-4402-4fcd-9371-02f98be67a3d tempest-TestInstancesWithCinderVolumes-745954434 None] Deleting attachment 7287347e-ffde-4c60-8263-2a3e61fd261b. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:50:19 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7.d530f1e5-8a3e-4319-a8c1-c5cdd3e23354" returned: 0 in 0.589s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Lock "cinder-quobyte-d530f1e5-8a3e-4319-a8c1-c5cdd3e23354" released by "_delete_snapshot" :: held 3.095s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.368s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.240s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb740fc-9a11-4a75-99fb-a9786b0b7ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73', 'volume_size': 2, 'source_volid': '165a31a7-b1f2-4c2b-b938-3235ef09e5b7', 'source_volstatus': 'available'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b75333-8385-4c41-b726-9d44969ca50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Creating offline snapshot 0e49635d-51d0-4524-b9ef-9af63062b866 of volume 52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:50:19 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Volume volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 (48841e7f-b97f-4c04-b09b-4d93b7a8fa73): created successfully Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b75333-8385-4c41-b726-9d44969ca50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Flow 'volume_create_manager' (66af134c-f5de-46ed-8e7d-96d26826fdd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:50:19 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c51e1ca-a777-4ee0-9776-97078b476df6]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:20 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d1937b02-cebd-4a7b-b9dc-cdf0def93bde tempest-VolumesCloneTest-265896852 None] Created volume successfully. Jun 03 14:50:20 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 Jun 03 14:50:20 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:20 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" returned: 0 in 0.728s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:20 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 1G Jun 03 14:50:20 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Acquiring lock "cinder-48841e7f-b97f-4c04-b09b-4d93b7a8fa73-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Lock "cinder-48841e7f-b97f-4c04-b09b-4d93b7a8fa73-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Acquiring lock "cinder-quobyte-48841e7f-b97f-4c04-b09b-4d93b7a8fa73" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Lock "cinder-quobyte-48841e7f-b97f-4c04-b09b-4d93b7a8fa73" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:20 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7247e4ff-eee4-4352-89cb-504bd4d2add0]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:21 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 Jun 03 14:50:21 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:21 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 1G" returned: 0 in 0.867s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:21 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 Jun 03 14:50:21 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:21 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73" returned: 0 in 0.758s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:21 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73 Jun 03 14:50:21 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:22 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866" returned: 0 in 0.656s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:22 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:22 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 Jun 03 14:50:22 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:22 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-48841e7f-b97f-4c04-b09b-4d93b7a8fa73" returned: 0 in 0.624s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Lock "cinder-quobyte-48841e7f-b97f-4c04-b09b-4d93b7a8fa73" released by "delete_volume" :: held 1.439s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Created reservations ['0a2c2255-b304-4088-93db-e55d038fad95', 'd472df96-b351-4114-b856-463362dd77c1', '6d03309e-f459-4263-966d-b7d245313f04', '336e8e27-1487-4a01-b560-e084820b6ea8'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:22 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:50:22 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:22 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866" returned: 0 in 0.646s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "cinder-ff02fffd-e3ae-4a42-b7e6-07bd8448b124-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-ff02fffd-e3ae-4a42-b7e6-07bd8448b124-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:22 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.info Jun 03 14:50:22 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "cinder-quobyte-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-quobyte-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" acquired by "delete_volume" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:23 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.645s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:50:23 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Deleted volume successfully. Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-41527b44-2eb3-4fb1-a953-d924a87b545c tempest-VolumesCloneTest-265896852 None] Lock "cinder-48841e7f-b97f-4c04-b09b-4d93b7a8fa73-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e0bf17-af1f-494a-915b-2cacd2f90203]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Acquiring lock "cinder-165a31a7-b1f2-4c2b-b938-3235ef09e5b7-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Lock "cinder-165a31a7-b1f2-4c2b-b938-3235ef09e5b7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Acquiring lock "cinder-quobyte-165a31a7-b1f2-4c2b-b938-3235ef09e5b7" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Lock "cinder-quobyte-165a31a7-b1f2-4c2b-b938-3235ef09e5b7" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:23 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 Jun 03 14:50:23 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[35403f25-67c2-43a6-88e7-53f8b3659757]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:23 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 Jun 03 14:50:23 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:23 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.info" returned: 0 in 0.698s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:23 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:23 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.info Jun 03 14:50:23 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:23 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" returned: 0 in 0.701s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:23 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 Jun 03 14:50:23 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:24 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7" returned: 0 in 0.747s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:24 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7 Jun 03 14:50:24 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:24 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.info" returned: 0 in 0.641s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.376s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=97,cinder:UPDATE=87,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Creating offline snapshot 6d5890a5-6c6e-4491-a617-2e8553c27137 of volume daec5ef7-a3d9-4840-809a-b660b3e0ce3d {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaefe10-8eaa-40e5-b6d6-46d700659cff]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:24 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d Jun 03 14:50:24 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:24 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" returned: 1 in 0.790s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:24 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124 Jun 03 14:50:24 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:24 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165a31a7-b1f2-4c2b-b938-3235ef09e5b7" returned: 0 in 0.629s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Lock "cinder-quobyte-165a31a7-b1f2-4c2b-b938-3235ef09e5b7" released by "delete_volume" :: held 1.450s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=89,cinder:UPDATE=88,cinder:INSERT=24,cinder:DELETE=4 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Created reservations ['4cd10e3c-bc0a-4a22-b3f3-0d40cbbbb611', '17075a61-c536-4db8-a256-7714b97b5248', 'ec961636-de3e-4449-b151-59ec7d2faa8d', 'f41d9db7-29f3-4546-bce9-909da9ec855f'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:24 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:50:24 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:25 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" returned: 0 in 0.777s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:25 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 1G Jun 03 14:50:25 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:25 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" returned: 0 in 0.624s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-quobyte-ff02fffd-e3ae-4a42-b7e6-07bd8448b124" released by "delete_volume" :: held 2.218s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:25 devstack cinder-volume[86614]: WARNING cinder.quota [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1214448137-1043056199 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1214448137-1043056199, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:25 devstack cinder-volume[86614]: WARNING cinder.quota [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1214448137-1043056199 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1214448137-1043056199, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Created reservations ['383ef480-2ae7-4ee8-94e4-5eaccec0cffb', '619809eb-8609-4837-bc45-f8542f679e16', '263182af-2987-43f6-9feb-9a37be595ea9', '31a756be-fb09-4409-993d-23248e060cf2'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:25 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:50:25 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:25 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.677s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:50:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Deleted volume successfully. Jun 03 14:50:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-54cd1a94-1331-41f5-99a5-63327eb70e12 tempest-VolumesCloneTest-265896852 None] Lock "cinder-165a31a7-b1f2-4c2b-b938-3235ef09e5b7-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:26 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:26 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.661s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:26 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:50:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 1G" returned: 0 in 0.912s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:26 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Deleted volume successfully. Jun 03 14:50:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0d867b6c-2844-4911-bc61-7493480dd0f0 tempest-TestInstancesWithCinderVolumes-745954434 None] Lock "cinder-ff02fffd-e3ae-4a42-b7e6-07bd8448b124-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:26 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 Jun 03 14:50:26 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:26 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137" returned: 0 in 0.846s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:26 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:50:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:26 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 Jun 03 14:50:26 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:27 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137" returned: 0 in 0.667s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:27 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.info Jun 03 14:50:27 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:28 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.info" returned: 0 in 0.667s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:28 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:28 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.info Jun 03 14:50:28 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Flow 'volume_create_manager' (20b38553-fce7-4f6b-95b4-f5c337118d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef3a3ec-d48c-43f9-92df-51b9a0d88c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef3a3ec-d48c-43f9-92df-51b9a0d88c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1044355042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff90c24-f796-49f8-9a68-71a1aa39c4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='913dc13a9c7d44df9c657673015fbdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:50:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:50:29Z,use_quota=True,user_id='086903f648c04aef82b424e864a6355c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e187ffe-5a65-4a7e-940c-6eace73ac058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e187ffe-5a65-4a7e-940c-6eace73ac058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081b2d2b-d191-4c46-b762-a0bd258ed080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081b2d2b-d191-4c46-b762-a0bd258ed080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff90c24-f796-49f8-9a68-71a1aa39c4fc', 'volume_name': 'volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc', 'volume_size': 2}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08b349e-cac8-4cc7-a887-71935623f588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08b349e-cac8-4cc7-a887-71935623f588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233ced14-3236-41ff-a6cf-7edefccf83a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:28 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Volume dff90c24-f796-49f8-9a68-71a1aa39c4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc', 'volume_size': 2} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:28 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.info" returned: 0 in 0.645s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.619s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-b75f6695-2e21-4c29-b16f-e9ea7e59540c req-e8005898-63e6-4c66-a261-0a88a6d05a9a tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.889s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6b9d77-6ba7-47b6-bef4-311091d8d412]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-b75f6695-2e21-4c29-b16f-e9ea7e59540c req-e8005898-63e6-4c66-a261-0a88a6d05a9a tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:29 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ee48c8f9-0cb1-411d-ad06-7930c76c03b1 tempest-GroupSnapshotsTest-611653072 None] group_snapshot a50f0c25-e948-4095-b92d-069c73b551b1: created successfully Jun 03 14:50:29 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 Jun 03 14:50:29 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:29 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] group_snapshot a50f0c25-e948-4095-b92d-069c73b551b1: deleting Jun 03 14:50:29 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-b75f6695-2e21-4c29-b16f-e9ea7e59540c req-e8005898-63e6-4c66-a261-0a88a6d05a9a tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116" returned: 0 in 0.772s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-b75f6695-2e21-4c29-b16f-e9ea7e59540c req-e8005898-63e6-4c66-a261-0a88a6d05a9a tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.790s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1044355042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff90c24-f796-49f8-9a68-71a1aa39c4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='913dc13a9c7d44df9c657673015fbdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:50:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:50:29Z,use_quota=True,user_id='086903f648c04aef82b424e864a6355c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Creating volume dff90c24-f796-49f8-9a68-71a1aa39c4fc {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:50:29 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc 2147483648 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] group_snapshot a50f0c25-e948-4095-b92d-069c73b551b1: deleting {{(pid=86614) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 03 14:50:29 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc 2147483648 Jun 03 14:50:29 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-b75f6695-2e21-4c29-b16f-e9ea7e59540c req-e8005898-63e6-4c66-a261-0a88a6d05a9a tempest-AttachVolumeShelveTestJSON-149926842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-289166f5-8378-4469-95d5-a30f978ce116', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b818a7e8-9947-4a41-9680-34e3c6cf7fd5', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-0e49635d-51d0-4524-b9ef-9af63062b866" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-0e49635d-51d0-4524-b9ef-9af63062b866" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Deleting offline snapshot 0e49635d-51d0-4524-b9ef-9af63062b866 of volume 52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] snapshot_file for this snap is: volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc0d4c-c484-4a21-a3ae-e057cb409e03]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:29 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-b75f6695-2e21-4c29-b16f-e9ea7e59540c req-e8005898-63e6-4c66-a261-0a88a6d05a9a tempest-AttachVolumeShelveTestJSON-149926842 None] attachment_update completed successfully. Jun 03 14:50:30 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 Jun 03 14:50:30 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:30 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866" returned: 0 in 0.876s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:50:30 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc 2147483648" returned: 0 in 1.096s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:30 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6bc668-ffbd-4970-b4f8-da35a1b5a95a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:30 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc Jun 03 14:50:30 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:31 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 Jun 03 14:50:31 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:31 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc" returned: 0 in 0.660s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:50:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233ced14-3236-41ff-a6cf-7edefccf83a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc', 'volume_size': 2}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e323b909-d760-489b-894d-1715099034e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:31 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Volume volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc (dff90c24-f796-49f8-9a68-71a1aa39c4fc): created successfully Jun 03 14:50:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e323b909-d760-489b-894d-1715099034e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Flow 'volume_create_manager' (20b38553-fce7-4f6b-95b4-f5c337118d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:50:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-05dada59-af2b-4705-86c3-f2940edd02b1 tempest-VolumesCloneNegativeTest-1741319313 None] Created volume successfully. Jun 03 14:50:31 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" returned: 0 in 0.779s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:31 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 Jun 03 14:50:31 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Acquiring lock "cinder-dff90c24-f796-49f8-9a68-71a1aa39c4fc-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Lock "cinder-dff90c24-f796-49f8-9a68-71a1aa39c4fc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Acquiring lock "cinder-quobyte-dff90c24-f796-49f8-9a68-71a1aa39c4fc" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Lock "cinder-quobyte-dff90c24-f796-49f8-9a68-71a1aa39c4fc" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:32 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[397ba623-bc76-479b-974d-d3b1406ab6cd]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:32 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc Jun 03 14:50:32 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:32 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866" returned: 0 in 0.845s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:32 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866 Jun 03 14:50:32 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:33 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc" returned: 0 in 0.787s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:33 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc Jun 03 14:50:33 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:33 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47.0e49635d-51d0-4524-b9ef-9af63062b866" returned: 0 in 0.636s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-0e49635d-51d0-4524-b9ef-9af63062b866" released by "_delete_snapshot" :: held 3.296s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" released by "delete_snapshot" :: held 3.332s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-6d5890a5-6c6e-4491-a617-2e8553c27137" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-6d5890a5-6c6e-4491-a617-2e8553c27137" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Deleting offline snapshot 6d5890a5-6c6e-4491-a617-2e8553c27137 of volume daec5ef7-a3d9-4840-809a-b660b3e0ce3d {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] snapshot_file for this snap is: volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbb6556-03bd-4c8b-ba5e-901ccc51f5bf]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:33 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 Jun 03 14:50:33 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:33 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-dff90c24-f796-49f8-9a68-71a1aa39c4fc" returned: 0 in 0.718s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Lock "cinder-quobyte-dff90c24-f796-49f8-9a68-71a1aa39c4fc" released by "delete_volume" :: held 1.557s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Created reservations ['a45524ce-18f8-43e0-9591-f3f2f4f30c34', '2b64b0e5-e35b-4541-973e-8cd904fcebb6', 'db58c8be-a421-4f47-bf22-78691869de52', 'd4f7ac19-6262-4855-82f4-fd124c6d67ad'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:33 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:50:33 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:34 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137" returned: 0 in 0.914s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:50:34 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[3874157c-527e-4eb5-9aea-ff3265d63c85]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:34 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d Jun 03 14:50:34 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:34 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.770s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:34 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:50:34 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Deleted volume successfully. Jun 03 14:50:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-89b6b721-fa54-4145-9711-c7975b5fc8ff tempest-VolumesCloneNegativeTest-1741319313 None] Lock "cinder-dff90c24-f796-49f8-9a68-71a1aa39c4fc-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:35 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" returned: 0 in 1.059s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:35 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 Jun 03 14:50:35 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:36 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137" returned: 0 in 0.901s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:36 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137 Jun 03 14:50:36 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:37 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d.6d5890a5-6c6e-4491-a617-2e8553c27137" returned: 0 in 0.807s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-6d5890a5-6c6e-4491-a617-2e8553c27137" released by "_delete_snapshot" :: held 3.808s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" released by "delete_snapshot" :: held 3.844s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:37 devstack cinder-volume[86614]: WARNING cinder.quota [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1068219875 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1068219875, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:37 devstack cinder-volume[86614]: WARNING cinder.quota [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1068219875 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1068219875, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:37 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Created reservations ['af8a5d40-1454-439d-b97e-51ea5a070dcb', '15809bcc-4f4f-4010-8008-814125b0c9a4', '277033f0-7924-4fe0-9403-3760381fdfac', '7c1d830a-57d2-40ad-abec-8d84814a4ba9'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:37 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] Created reservations ['b47597cc-8a70-4f2d-aefe-a99b4806e2da', 'b2b4ac5b-922a-4154-9594-898c55ce9e96', 'ce3896b8-66a4-4315-9374-b94794f34172', '2bb69eaf-f519-43c8-b5df-64a6bba26252'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4e246bc1-3e6f-441e-a088-fb9ffabcf3b4 tempest-GroupSnapshotsTest-611653072 None] group_snapshot a50f0c25-e948-4095-b92d-069c73b551b1: deleted successfully Jun 03 14:50:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" acquired by "delete_volume" :: waited 0.028s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:38 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[af03ef12-032e-4756-89ec-1c7d5fade9a2]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:39 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 Jun 03 14:50:39 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:40 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" returned: 0 in 1.164s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:40 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47 Jun 03 14:50:40 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Flow 'volume_create_manager' (65ea5468-7d7b-457a-8250-996447ffcd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce467dac-3096-4c81-9c49-3c6594cb7a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce467dac-3096-4c81-9c49-3c6594cb7a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-810094496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4205062b-958c-4fd0-8ef2-63d985e69ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f023820455d94ba58b928fb0cbf48d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:50:40Z,use_quota=True,user_id='ca1afcf0f10343c6b87ebfad28049dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129ac72e-d131-4fb5-abff-17097def8abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129ac72e-d131-4fb5-abff-17097def8abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1b46b6-f7bd-4541-8b57-7c557205ae1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.image.glance [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Creating Keystone auth plugin from conf {{(pid=86614) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1b46b6-f7bd-4541-8b57-7c557205ae1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4205062b-958c-4fd0-8ef2-63d985e69ce6', 'volume_name': 'volume-4205062b-958c-4fd0-8ef2-63d985e69ce6', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666d819d-ef22-4033-a27b-bffbd3deefe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666d819d-ef22-4033-a27b-bffbd3deefe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c0415c-fada-4a67-b284-9f6323bd3d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:40 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Volume 4205062b-958c-4fd0-8ef2-63d985e69ce6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4205062b-958c-4fd0-8ef2-63d985e69ce6', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Trying to clone 4205062b-958c-4fd0-8ef2-63d985e69ce6 from image 839cbef2-b314-44e2-9fd2-f453c1210770 at location (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]). {{(pid=86614) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 03 14:50:40 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" returned: 0 in 0.815s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-52c7bd9e-29da-44d6-9331-ddfdd5a5cf47" released by "delete_volume" :: held 2.094s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" acquired by "delete_volume" :: waited 0.034s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb70263-611b-4edd-b27b-450d73ee9ed3]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:41 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d Jun 03 14:50:41 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:41 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 03 14:50:41 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Image download 20.69 MB at 20.69 MB/s Jun 03 14:50:41 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc0bb0e-45b6-44bd-9cda-3a5a4b14226b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:41 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD Jun 03 14:50:41 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:41 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" returned: 0 in 0.862s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:41 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d Jun 03 14:50:41 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:42 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Temporary image 839cbef2-b314-44e2-9fd2-f453c1210770 is fetched for user ca1afcf0f10343c6b87ebfad28049dca. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0d9f15-009a-449a-8186-bbe7a7838309]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:42 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD Jun 03 14:50:42 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:42 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" returned: 0 in 0.807s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-daec5ef7-a3d9-4840-809a-b660b3e0ce3d" released by "delete_volume" :: held 1.748s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Created reservations ['ca0b7de0-55c9-48aa-9fe8-63924c9cb683'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:42 devstack cinder-volume[86614]: WARNING cinder.quota [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1068219875 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1068219875, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Created reservations ['bc50e90c-5009-4d65-8684-43b242bed8b5', '7dc9c345-5c82-4a9a-bf0a-6c83e65e06aa', '308a0ef4-4081-4834-a7a2-e31e2a1889f7', '52bc25d1-8b43-432a-bf0a-4a81e73ec2b5'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:42 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-810094496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4205062b-958c-4fd0-8ef2-63d985e69ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f023820455d94ba58b928fb0cbf48d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:50:40Z,use_quota=True,user_id='ca1afcf0f10343c6b87ebfad28049dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Creating volume 4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:50:42 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:50:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:43 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 1073741824 Jun 03 14:50:43 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:43 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Created reservations ['942fbb05-d638-4219-bad2-5523bba77677', '793731e9-b4b7-466e-afd2-ef41ce6b19f8', '7a2349c2-9bd4-4401-9038-519f4540e050', '25c7f0a9-cb94-45b0-a7ff-bd8445f06552'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:43 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:50:43 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:44 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 1073741824" returned: 0 in 1.167s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-35076aa6-0aa2-4e95-8a45-c442c7fb94b8 tempest-GroupSnapshotsTest-611653072 None] Group tempest-GroupSnapshotsTest-Group-380760330: creating Jun 03 14:50:44 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.972s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:44 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:50:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a8ea269d-b838-441b-a890-615731e2096e tempest-GroupSnapshotsTest-611653072 None] Delete group completed successfully. Jun 03 14:50:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-35076aa6-0aa2-4e95-8a45-c442c7fb94b8 tempest-GroupSnapshotsTest-611653072 None] Group tempest-GroupSnapshotsTest-Group-380760330: created successfully Jun 03 14:50:44 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 Jun 03 14:50:44 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-35076aa6-0aa2-4e95-8a45-c442c7fb94b8 tempest-GroupSnapshotsTest-611653072 None] Create group completed successfully. Jun 03 14:50:44 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6" returned: 0 in 0.596s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:50:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:44 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Attempting download of 839cbef2-b314-44e2-9fd2-f453c1210770 ((None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}])) to volume 4205062b-958c-4fd0-8ef2-63d985e69ce6. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 03 14:50:44 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1c272f-ed88-4949-b08a-713e603c9c74]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_nu2i4zcl {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:45 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_nu2i4zcl Jun 03 14:50:45 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_nu2i4zcl" returned: 0 in 0.842s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_nu2i4zcl {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:45 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:45 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_nu2i4zcl Jun 03 14:50:45 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:45 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:50:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Flow 'volume_create_manager' (690db57f-3f8a-4e14-a9b5-da9907a13849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30aafaf0-e2f4-496b-a9d7-327293842b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30aafaf0-e2f4-496b-a9d7-327293842b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1639815697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33c05d5b-84a7-4319-8055-bf317b1cab85,host='devstack@QuobyteHD#QuobyteHD',id=c25664e1-9510-4aa8-8913-8e2984509140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705760f4c6154bc4bae20b48ba559795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:50:46Z,use_quota=True,user_id='755ef5ba4078474d837bd99eaf790cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aeff5d11-3430-45ab-979f-6167e4f0b5d6),volume_type_id=aeff5d11-3430-45ab-979f-6167e4f0b5d6)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468ea2c3-8eaa-4443-bd43-83d14e2e6a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468ea2c3-8eaa-4443-bd43-83d14e2e6a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f1e7ae-61f6-43f1-be45-9702261f573b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f1e7ae-61f6-43f1-be45-9702261f573b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25664e1-9510-4aa8-8913-8e2984509140', 'volume_name': 'volume-c25664e1-9510-4aa8-8913-8e2984509140', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5c97c0-37a4-4953-bb6e-0ec5aace5e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5c97c0-37a4-4953-bb6e-0ec5aace5e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7d4aa9-a762-4a62-a06d-b851824e1d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:46 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Volume c25664e1-9510-4aa8-8913-8e2984509140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25664e1-9510-4aa8-8913-8e2984509140', 'volume_size': 1} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=33c05d5b-84a7-4319-8055-bf317b1cab85,created_at=2026-06-03T12:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1639815697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33c05d5b-84a7-4319-8055-bf317b1cab85,host='devstack@QuobyteHD#QuobyteHD',id=c25664e1-9510-4aa8-8913-8e2984509140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705760f4c6154bc4bae20b48ba559795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:50:46Z,use_quota=True,user_id='755ef5ba4078474d837bd99eaf790cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aeff5d11-3430-45ab-979f-6167e4f0b5d6),volume_type_id=aeff5d11-3430-45ab-979f-6167e4f0b5d6)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Creating volume c25664e1-9510-4aa8-8913-8e2984509140 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:50:46 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:46 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 1073741824 Jun 03 14:50:46 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:46 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_nu2i4zcl" returned: 1 in 0.777s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_nu2i4zcl' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d804919c-c3d4-466e-bc29-4802d2326fb0]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:46 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD Jun 03 14:50:46 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:46 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 1073741824" returned: 0 in 0.889s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:47 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 Jun 03 14:50:47 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:47 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] 839cbef2-b314-44e2-9fd2-f453c1210770 was qcow2, converting to raw {{(pid=86614) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:47 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 Jun 03 14:50:47 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:47 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140" returned: 0 in 0.827s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7d4aa9-a762-4a62-a06d-b851824e1d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25664e1-9510-4aa8-8913-8e2984509140', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4f1696-2126-452b-aaea-16e983ed583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:47 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Volume volume-c25664e1-9510-4aa8-8913-8e2984509140 (c25664e1-9510-4aa8-8913-8e2984509140): created successfully Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4f1696-2126-452b-aaea-16e983ed583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Flow 'volume_create_manager' (690db57f-3f8a-4e14-a9b5-da9907a13849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:50:47 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-44b6a854-eb06-47f8-b92b-d0fb27adbd58 tempest-GroupSnapshotsTest-611653072 None] Created volume successfully. Jun 03 14:50:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] GroupSnapshot 84f67da4-f445-44dd-9517-a5cf8aea1ad0: creating. Jun 03 14:50:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Group snapshot 84f67da4-f445-44dd-9517-a5cf8aea1ad0: creating. {{(pid=86614) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 03 14:50:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Creating offline snapshot 6082fab7-09ee-4b34-a074-b16c72362d62 of volume c25664e1-9510-4aa8-8913-8e2984509140 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:50:48 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2044a2-9be9-48d9-b588-612b87c5fd96]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:49 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 Jun 03 14:50:49 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:50 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140" returned: 0 in 1.295s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:50 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 1G Jun 03 14:50:50 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:50 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6" returned: 0 in 3.246s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:50 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_njxbzodudevstack@QuobyteHD, size 112.00 MB, duration 3.25 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:50:50 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Converted 112.00 MB image at 34.49 MB/s Jun 03 14:50:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:50 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 1G Jun 03 14:50:50 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:51 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 1G" returned: 0 in 1.327s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c25664e1-9510-4aa8-8913-8e2984509140 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:51 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c25664e1-9510-4aa8-8913-8e2984509140 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 Jun 03 14:50:51 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:51 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 1G" returned: 0 in 1.082s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:51 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abebb6b-ebb8-46c2-b5b5-a1182925fbfc]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:52 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 Jun 03 14:50:52 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:52 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c25664e1-9510-4aa8-8913-8e2984509140 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62" returned: 0 in 0.994s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:52 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:50:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:52 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 Jun 03 14:50:52 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:52 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6" returned: 0 in 0.917s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:52 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 Jun 03 14:50:52 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:53 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62" returned: 0 in 0.837s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:53 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.info Jun 03 14:50:53 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:50:53 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6" returned: 1 in 0.856s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Downloaded image 839cbef2-b314-44e2-9fd2-f453c1210770 ((None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}])) to volume 4205062b-958c-4fd0-8ef2-63d985e69ce6 successfully. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Temporary image 839cbef2-b314-44e2-9fd2-f453c1210770 for user ca1afcf0f10343c6b87ebfad28049dca is deleted. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Marking volume 4205062b-958c-4fd0-8ef2-63d985e69ce6 as bootable. {{(pid=86614) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 03 14:50:53 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Copying metadata from image 839cbef2-b314-44e2-9fd2-f453c1210770 to 4205062b-958c-4fd0-8ef2-63d985e69ce6. {{(pid=86614) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Creating volume glance metadata for volume 4205062b-958c-4fd0-8ef2-63d985e69ce6 backed by image 839cbef2-b314-44e2-9fd2-f453c1210770 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86614) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 14:50:53 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c0415c-fada-4a67-b284-9f6323bd3d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4205062b-958c-4fd0-8ef2-63d985e69ce6', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d4fe57-568a-4736-9734-f57734425a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:50:53 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Volume volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 (4205062b-958c-4fd0-8ef2-63d985e69ce6): created successfully Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d4fe57-568a-4736-9734-f57734425a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:50:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Flow 'volume_create_manager' (65ea5468-7d7b-457a-8250-996447ffcd6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:50:53 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-65903c63-c440-4bfa-bfcc-66d83130d82a tempest-VolumesExtendTest-1010755848 None] Created volume successfully. Jun 03 14:50:54 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.info" returned: 0 in 0.841s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:54 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:54 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.info Jun 03 14:50:54 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:54 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.880s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:50:54 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.info" returned: 0 in 0.783s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.185s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.181s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d550445-e846-417f-bd48-5abb9208d5c6]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:55 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-517cbff2-cc5c-4f9b-9847-fe637712966e tempest-GroupSnapshotsTest-611653072 None] group_snapshot 84f67da4-f445-44dd-9517-a5cf8aea1ad0: created successfully Jun 03 14:50:55 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 Jun 03 14:50:55 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:55 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] group_snapshot 84f67da4-f445-44dd-9517-a5cf8aea1ad0: deleting Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] group_snapshot 84f67da4-f445-44dd-9517-a5cf8aea1ad0: deleting {{(pid=86614) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-c25664e1-9510-4aa8-8913-8e2984509140" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-c25664e1-9510-4aa8-8913-8e2984509140" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-6082fab7-09ee-4b34-a074-b16c72362d62" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-6082fab7-09ee-4b34-a074-b16c72362d62" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Deleting offline snapshot 6082fab7-09ee-4b34-a074-b16c72362d62 of volume c25664e1-9510-4aa8-8913-8e2984509140 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] snapshot_file for this snap is: volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[42275c7b-8d7f-4d32-a234-cbe888332139]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:55 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 Jun 03 14:50:55 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:56 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6" returned: 0 in 1.016s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:56 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 Jun 03 14:50:56 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:56 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62" returned: 0 in 0.937s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c25664e1-9510-4aa8-8913-8e2984509140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:50:56 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e6e1f5-6ed2-4365-8c31-48014b28f2d5]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:56 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 Jun 03 14:50:56 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:56 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6" returned: 1 in 0.855s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:50:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 2G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 2G" returned: 0 in 0.085s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:50:57 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8f8e928e-0588-4aa1-8e2f-a8a7772213c7 tempest-VolumesExtendTest-1010755848 None] Extend volume completed successfully. Jun 03 14:50:57 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140" returned: 0 in 0.893s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:57 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 Jun 03 14:50:57 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Acquiring lock "cinder-4205062b-958c-4fd0-8ef2-63d985e69ce6-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Lock "cinder-4205062b-958c-4fd0-8ef2-63d985e69ce6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Acquiring lock "cinder-quobyte-4205062b-958c-4fd0-8ef2-63d985e69ce6" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:50:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Lock "cinder-quobyte-4205062b-958c-4fd0-8ef2-63d985e69ce6" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:50:58 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62" returned: 0 in 1.102s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:58 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[de05cecc-f28b-491b-9537-2ea9cbdf4dfb]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:50:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:58 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62 Jun 03 14:50:58 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:58 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 Jun 03 14:50:58 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:50:59 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140.6082fab7-09ee-4b34-a074-b16c72362d62" returned: 0 in 0.786s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-6082fab7-09ee-4b34-a074-b16c72362d62" released by "_delete_snapshot" :: held 3.901s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-c25664e1-9510-4aa8-8913-8e2984509140" released by "delete_snapshot" :: held 3.933s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:50:59 devstack cinder-volume[86614]: WARNING cinder.quota [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-920211834 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-920211834, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:59 devstack cinder-volume[86614]: WARNING cinder.quota [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-920211834 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-920211834, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:50:59 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] Created reservations ['c054a155-162d-4b2b-a15f-b992f1081006', 'ba215cea-a81c-4a4c-a96d-5fd9e8b9e12d', '02fee6bd-7b75-44d9-b641-53db8e7eef30', '295eb4f4-f327-48bf-bc1c-533d02a5fc8b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:50:59 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jun 03 14:50:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6" returned: 0 in 1.141s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:50:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:50:59 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-223a3187-321d-41ac-88bd-5d32b33f9ada tempest-GroupSnapshotsTest-611653072 None] group_snapshot 84f67da4-f445-44dd-9517-a5cf8aea1ad0: deleted successfully Jun 03 14:51:00 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 Jun 03 14:51:00 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "cinder-quobyte-c25664e1-9510-4aa8-8913-8e2984509140" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-c25664e1-9510-4aa8-8913-8e2984509140" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:00 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdbfd67-e9e2-4ee4-9d3e-a9549284fc6d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:00 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 Jun 03 14:51:00 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:00 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6" returned: 1 in 1.107s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:51:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:00 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6 Jun 03 14:51:00 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:01 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140" returned: 0 in 1.035s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:01 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140 Jun 03 14:51:01 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:01 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4205062b-958c-4fd0-8ef2-63d985e69ce6" returned: 0 in 0.794s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Lock "cinder-quobyte-4205062b-958c-4fd0-8ef2-63d985e69ce6" released by "delete_volume" :: held 3.160s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Created reservations ['9a97c325-9008-4490-b995-00e8dd127669', 'c11dbdea-676a-4827-a2c4-23f4d18d6aca', '75e41e4d-1d3d-4264-8840-ac5296030325', '61abafe2-f71e-423d-91e6-78635270dc38'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:01 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:51:01 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:02 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c25664e1-9510-4aa8-8913-8e2984509140" returned: 0 in 0.979s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Lock "cinder-quobyte-c25664e1-9510-4aa8-8913-8e2984509140" released by "delete_volume" :: held 2.132s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Flow 'volume_create_manager' (c2c47d0f-bdff-4f69-9e24-e53a10a3f5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd65aa3-30a9-4030-b89a-52554af6282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Created reservations ['4969930f-2d91-44a5-8260-eaddc3c1aa59'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd65aa3-30a9-4030-b89a-52554af6282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1758481554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9975e503-6bd7-4ec1-9d54-951154d4a0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f023820455d94ba58b928fb0cbf48d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:51:03Z,use_quota=True,user_id='ca1afcf0f10343c6b87ebfad28049dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bbfffb-b224-4e4e-8d5a-f2d7c2030247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bbfffb-b224-4e4e-8d5a-f2d7c2030247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1c4ae4-8264-421b-abb3-0f34413c80d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1c4ae4-8264-421b-abb3-0f34413c80d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9975e503-6bd7-4ec1-9d54-951154d4a0d8', 'volume_name': 'volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231f35c4-558b-4d5c-9b85-000169c2c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231f35c4-558b-4d5c-9b85-000169c2c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8182140d-3685-40ba-acd6-218acef5698e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:02 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Volume 9975e503-6bd7-4ec1-9d54-951154d4a0d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8', 'volume_size': 1} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1758481554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9975e503-6bd7-4ec1-9d54-951154d4a0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f023820455d94ba58b928fb0cbf48d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:51:03Z,use_quota=True,user_id='ca1afcf0f10343c6b87ebfad28049dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Creating volume 9975e503-6bd7-4ec1-9d54-951154d4a0d8 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:51:02 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:02 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 1073741824 Jun 03 14:51:02 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:02 devstack cinder-volume[86614]: WARNING cinder.quota [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-920211834 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-920211834, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:51:02 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Created reservations ['1ef64fb6-ffe3-42fd-afff-5ae835fe8a22', 'a6539944-14d0-4679-a399-64949868b9cc', 'cc33d894-3b24-40ee-ac8d-41af5c3558bf', '5e48992b-9d15-4b1a-8851-aeaa5f21485a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:51:03 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.116s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:51:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Deleted volume successfully. Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bd264c10-d7e2-48d1-be40-e00e43a80ebd tempest-VolumesExtendTest-1010755848 None] Lock "cinder-4205062b-958c-4fd0-8ef2-63d985e69ce6-delete_volume" released by "delete_volume" :: held 4.603s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:03 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:51:03 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:03 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.633s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:51:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-95b7bc8a-4307-4a4d-acda-c880e953d181 tempest-GroupSnapshotsTest-611653072 None] Delete group completed successfully. Jun 03 14:51:03 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 1073741824" returned: 0 in 0.882s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:03 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 Jun 03 14:51:03 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:04 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8" returned: 0 in 0.650s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:51:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8182140d-3685-40ba-acd6-218acef5698e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562a2593-1c49-430e-acb3-654cc846c76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:04 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Volume volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 (9975e503-6bd7-4ec1-9d54-951154d4a0d8): created successfully Jun 03 14:51:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562a2593-1c49-430e-acb3-654cc846c76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Flow 'volume_create_manager' (c2c47d0f-bdff-4f69-9e24-e53a10a3f5e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:51:04 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8275d4b3-8ac5-48f5-8be1-fe6da9e6397b tempest-VolumesExtendTest-1010755848 None] Created volume successfully. Jun 03 14:51:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Creating offline snapshot 261f07f0-890f-4515-9d55-6201d9987c01 of volume 9975e503-6bd7-4ec1-9d54-951154d4a0d8 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:51:05 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf18f0d-2379-4e78-a73f-313281a87e71]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:05 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 Jun 03 14:51:05 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:06 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8" returned: 0 in 0.772s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:06 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 1G Jun 03 14:51:06 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:07 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 1G" returned: 0 in 0.840s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:07 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 Jun 03 14:51:07 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:07 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01" returned: 0 in 0.727s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:07 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 is being set with open permissions: ugo+rw Jun 03 14:51:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:07 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 Jun 03 14:51:07 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:08 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01" returned: 0 in 0.630s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:08 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.info Jun 03 14:51:08 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:09 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.info" returned: 0 in 0.595s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:09 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.info is being set with open permissions: ugo+rw Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:09 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.info Jun 03 14:51:09 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Flow 'volume_create_manager' (60adc2e3-cac8-46ab-b1e7-c25bc7129b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e86d64-67ef-440e-849d-dd70427176c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e86d64-67ef-440e-849d-dd70427176c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-397907845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756131ca773f42d68fdf2446de8788a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:51:09Z,use_quota=True,user_id='5e53249b0c414587a0c522a9cbdd2518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8ac1fe-786b-42bd-b3a0-3b7019c14b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8ac1fe-786b-42bd-b3a0-3b7019c14b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f761ab4-dbca-4a6b-8d1e-15e4d2ebff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.image.glance [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Creating Keystone auth plugin from conf {{(pid=86614) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 14:51:09 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.info" returned: 0 in 0.639s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.357s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:09 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-10372832-73ff-44e3-8988-6ec3d3ec4466 tempest-VolumesExtendTest-1010755848 None] Create snapshot completed successfully Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Flow 'volume_create_manager' (acfeda1b-4dee-45cd-ba96-e2bcb77b5183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e14261-88a7-4ba7-8253-140e7e7ab4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e14261-88a7-4ba7-8253-140e7e7ab4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-870936995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514f53e4-5432-4b53-a215-924a0c15f602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092d4d0a7d9b4660a4b11001764042b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:51:10Z,use_quota=True,user_id='054afa69aa684d8b9f995c57d8b438b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7124fff-049c-45d7-989f-408c72637257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7124fff-049c-45d7-989f-408c72637257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50dc90c-ca84-476f-9704-e98d67f48446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50dc90c-ca84-476f-9704-e98d67f48446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '514f53e4-5432-4b53-a215-924a0c15f602', 'volume_name': 'volume-514f53e4-5432-4b53-a215-924a0c15f602', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8994316a-6d94-42b6-81e7-64f61f709d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8994316a-6d94-42b6-81e7-64f61f709d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab313815-d744-48fa-a1bc-d78ad61f51a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:09 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Volume 514f53e4-5432-4b53-a215-924a0c15f602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-514f53e4-5432-4b53-a215-924a0c15f602', 'volume_size': 1} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-870936995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514f53e4-5432-4b53-a215-924a0c15f602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092d4d0a7d9b4660a4b11001764042b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:51:10Z,use_quota=True,user_id='054afa69aa684d8b9f995c57d8b438b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Creating volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:51:09 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:09 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 1073741824 Jun 03 14:51:09 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f761ab4-dbca-4a6b-8d1e-15e4d2ebff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2', 'volume_name': 'volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb8f310-8d7f-4f42-9b6c-7f1d8765fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb8f310-8d7f-4f42-9b6c-7f1d8765fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98978a02-9717-470b-83d7-9e873bbf7ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:09 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Volume 85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 03 14:51:09 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Trying to clone 85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 from image 839cbef2-b314-44e2-9fd2-f453c1210770 at location (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]). {{(pid=86614) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 03 14:51:10 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 03 14:51:10 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Image download 20.69 MB at 20.69 MB/s Jun 03 14:51:10 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d2e59d-8dfd-45cf-b1c3-da93f2030da1]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:10 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD Jun 03 14:51:10 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6dd24c9f-6c40-4cee-acc1-85917e194f25 tempest-VolumesExtendTest-1010755848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:10 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 1073741824" returned: 0 in 1.011s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:10 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 Jun 03 14:51:10 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:11 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Temporary image 839cbef2-b314-44e2-9fd2-f453c1210770 is fetched for user 5e53249b0c414587a0c522a9cbdd2518. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[47727a98-0924-49a3-96cb-25f40c6e47b5]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:11 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD Jun 03 14:51:11 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:11 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602" returned: 0 in 0.680s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6dd24c9f-6c40-4cee-acc1-85917e194f25 tempest-VolumesExtendTest-1010755848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.847s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bfbe7c-c946-4362-ac95-83dea1f6548f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6dd24c9f-6c40-4cee-acc1-85917e194f25 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab313815-d744-48fa-a1bc-d78ad61f51a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-514f53e4-5432-4b53-a215-924a0c15f602', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb91d4ef-e300-4ef6-bf5f-431158cff20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:11 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Volume volume-514f53e4-5432-4b53-a215-924a0c15f602 (514f53e4-5432-4b53-a215-924a0c15f602): created successfully Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb91d4ef-e300-4ef6-bf5f-431158cff20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Flow 'volume_create_manager' (acfeda1b-4dee-45cd-ba96-e2bcb77b5183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:51:11 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-da6988dd-7c7e-482d-8c3c-ef275f819b80 tempest-SnapshotsActionsTest-515468414 None] Created volume successfully. Jun 03 14:51:11 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 Jun 03 14:51:11 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:12 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:12 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6dd24c9f-6c40-4cee-acc1-85917e194f25 tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8" returned: 0 in 0.781s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6dd24c9f-6c40-4cee-acc1-85917e194f25 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 2G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6dd24c9f-6c40-4cee-acc1-85917e194f25 tempest-VolumesExtendTest-1010755848 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 2G" returned: 0 in 0.115s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6dd24c9f-6c40-4cee-acc1-85917e194f25 tempest-VolumesExtendTest-1010755848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.931s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-397907845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756131ca773f42d68fdf2446de8788a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:51:09Z,use_quota=True,user_id='5e53249b0c414587a0c522a9cbdd2518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Creating volume 85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:51:12 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:12 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 1073741824 Jun 03 14:51:12 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:12 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-6dd24c9f-6c40-4cee-acc1-85917e194f25 tempest-VolumesExtendTest-1010755848 None] Extend volume completed successfully. Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Acquiring lock "cinder-261f07f0-890f-4515-9d55-6201d9987c01-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Lock "cinder-261f07f0-890f-4515-9d55-6201d9987c01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Acquiring lock "cinder-quobyte-9975e503-6bd7-4ec1-9d54-951154d4a0d8" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Lock "cinder-quobyte-9975e503-6bd7-4ec1-9d54-951154d4a0d8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Acquiring lock "cinder-quobyte-261f07f0-890f-4515-9d55-6201d9987c01" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Lock "cinder-quobyte-261f07f0-890f-4515-9d55-6201d9987c01" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Deleting offline snapshot 261f07f0-890f-4515-9d55-6201d9987c01 of volume 9975e503-6bd7-4ec1-9d54-951154d4a0d8 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] snapshot_file for this snap is: volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb14bd37-bae3-411c-afa2-fd1cc56c1997]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:13 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 Jun 03 14:51:13 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:13 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 1073741824" returned: 0 in 0.788s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:13 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:51:13 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:13 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-bcc25950-972a-4da2-9b28-5cee5e2957fc req-0c28c7dd-6fac-4524-9aaf-4449d9567ee5 tempest-AttachVolumeShelveTestJSON-149926842 None] Terminate volume connection completed successfully. Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-bcc25950-972a-4da2-9b28-5cee5e2957fc req-0c28c7dd-6fac-4524-9aaf-4449d9567ee5 tempest-AttachVolumeShelveTestJSON-149926842 None] Deleting attachment b818a7e8-9947-4a41-9680-34e3c6cf7fd5. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:51:13 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01" returned: 0 in 0.813s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbca8b4-f5b6-4ad6-9012-91d0c6ee3f03]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:13 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 0 in 0.641s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.835s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Creating offline snapshot e846ca2f-49ba-4a02-bcaa-a1670dc6c189 of volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:51:13 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 Jun 03 14:51:13 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[995003d8-2b7b-4bae-872e-6a2e1d3095db]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Attempting download of 839cbef2-b314-44e2-9fd2-f453c1210770 ((None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}])) to volume 85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd57383-ad2e-4a1d-b42c-ca0086cfd470]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_wcxbldzw {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:14 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 Jun 03 14:51:14 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:14 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_wcxbldzw Jun 03 14:51:14 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:14 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8" returned: 0 in 0.715s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:14 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 Jun 03 14:51:14 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:14 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602" returned: 0 in 0.812s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:14 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_wcxbldzw" returned: 0 in 0.759s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_wcxbldzw {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:14 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 1G Jun 03 14:51:14 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:14 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_wcxbldzw Jun 03 14:51:14 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:15 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01" returned: 0 in 0.735s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:15 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01 Jun 03 14:51:15 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:15 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_wcxbldzw" returned: 1 in 0.753s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_wcxbldzw' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:51:15 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e988ee-d705-4ea9-9301-5ba3d539813d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:15 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 1G" returned: 0 in 0.882s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:15 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD Jun 03 14:51:15 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:15 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:51:15 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:16 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8.261f07f0-890f-4515-9d55-6201d9987c01" returned: 0 in 0.718s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Lock "cinder-quobyte-261f07f0-890f-4515-9d55-6201d9987c01" released by "_delete_snapshot" :: held 3.104s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Lock "cinder-quobyte-9975e503-6bd7-4ec1-9d54-951154d4a0d8" released by "delete_snapshot" :: held 3.125s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:16 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Created reservations ['53c63d63-cad6-4789-8d5d-d92df9e47b64', '0f4135a9-a93d-4fdf-a3e3-3624715da72d', 'ac4f2570-3a13-4566-864a-3f8ba9b239ee', '425d2041-a8fb-4a98-b810-fffcf6a5a359'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:51:16 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Delete snapshot completed successfully. Jun 03 14:51:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-36f8c3d6-1831-426a-a13c-f6623d07547b tempest-VolumesExtendTest-1010755848 None] Lock "cinder-261f07f0-890f-4515-9d55-6201d9987c01-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:16 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:16 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] 839cbef2-b314-44e2-9fd2-f453c1210770 was qcow2, converting to raw {{(pid=86614) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 03 14:51:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:16 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:51:16 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:16 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.722s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:16 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 is being set with open permissions: ugo+rw Jun 03 14:51:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:16 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:51:16 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:17 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.791s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:17 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.info Jun 03 14:51:17 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Acquiring lock "cinder-9975e503-6bd7-4ec1-9d54-951154d4a0d8-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Lock "cinder-9975e503-6bd7-4ec1-9d54-951154d4a0d8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Acquiring lock "cinder-quobyte-9975e503-6bd7-4ec1-9d54-951154d4a0d8" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Lock "cinder-quobyte-9975e503-6bd7-4ec1-9d54-951154d4a0d8" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:17 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04a00d2-1343-4f85-9e19-b466b53cede9]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:17 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 Jun 03 14:51:17 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:18 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.info" returned: 0 in 0.803s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:18 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.info is being set with open permissions: ugo+rw Jun 03 14:51:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:18 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.info Jun 03 14:51:18 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:18 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8" returned: 0 in 0.913s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:18 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8 Jun 03 14:51:18 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:18 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 0 in 2.282s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:18 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_gckyzfnidevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:51:18 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Converted 112.00 MB image at 49.05 MB/s Jun 03 14:51:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:18 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 1G Jun 03 14:51:18 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:18 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.info" returned: 0 in 0.692s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.846s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:18 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-82c80f9b-1864-4aa1-af3a-4f62361da0d7 tempest-SnapshotsActionsTest-515468414 None] Create snapshot completed successfully Jun 03 14:51:19 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9975e503-6bd7-4ec1-9d54-951154d4a0d8" returned: 0 in 0.843s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Lock "cinder-quobyte-9975e503-6bd7-4ec1-9d54-951154d4a0d8" released by "delete_volume" :: held 1.870s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Created reservations ['f1eb73fd-1639-458e-ab71-49247de116ce', 'b91bd4a2-5725-4c33-a605-53ce69e04033', 'd6da8d63-37f9-4e91-b988-f53722536fa9', 'e65382f9-f98b-43b6-9ab9-7c131957dcaf'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:51:19 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 1G" returned: 0 in 0.807s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7f9a56-236e-4355-b6cf-62ea5e6ba980]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:19 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:51:19 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:19 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:51:19 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] Creating offline snapshot 6eb22385-86b0-4037-a368-c729700096a6 of volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0b0dfb-05c2-4ad4-8d8d-f4c121ff0381]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:20 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.706s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:51:20 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Deleted volume successfully. Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5a7d600e-fd01-424a-b0d7-0c14615f3117 tempest-VolumesExtendTest-1010755848 None] Lock "cinder-9975e503-6bd7-4ec1-9d54-951154d4a0d8-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:20 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:51:20 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:20 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 0 in 1.025s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:20 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:51:20 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:20 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.862s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:21 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 1G Jun 03 14:51:21 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:21 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 1 in 0.800s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Downloaded image 839cbef2-b314-44e2-9fd2-f453c1210770 ((None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}])) to volume 85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 successfully. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Temporary image 839cbef2-b314-44e2-9fd2-f453c1210770 for user 5e53249b0c414587a0c522a9cbdd2518 is deleted. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Marking volume 85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 as bootable. {{(pid=86614) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Copying metadata from image 839cbef2-b314-44e2-9fd2-f453c1210770 to 85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2. {{(pid=86614) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Creating volume glance metadata for volume 85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 backed by image 839cbef2-b314-44e2-9fd2-f453c1210770 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86614) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98978a02-9717-470b-83d7-9e873bbf7ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45cd292-e7c2-44f3-b752-683f4a3a31aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:21 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Volume volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 (85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2): created successfully Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45cd292-e7c2-44f3-b752-683f4a3a31aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Flow 'volume_create_manager' (60adc2e3-cac8-46ab-b1e7-c25bc7129b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:51:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-15261216-bc47-471b-aa05-a1e46b3bc965 tempest-TestShelveInstance-686681569 None] Created volume successfully. Jun 03 14:51:21 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 1G" returned: 0 in 0.903s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:21 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 Jun 03 14:51:21 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:22 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6" returned: 0 in 0.704s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:22 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 is being set with open permissions: ugo+rw Jun 03 14:51:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:22 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 Jun 03 14:51:22 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Flow 'volume_create_manager' (56574a10-a90a-4a70-9ac7-9b29975cafb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b324032c-5987-4a26-98f8-d31b4aa15f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b324032c-5987-4a26-98f8-d31b4aa15f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-913077349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd873e0-048f-42cf-90fc-869552b552a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328df6dc157342b9891c51dfe89e7917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:51:23Z,use_quota=True,user_id='1d3ff38309354e33a948c7a01ad067bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476857a1-7f7d-4f8a-b8e9-322cda9763d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476857a1-7f7d-4f8a-b8e9-322cda9763d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107c7765-923d-4e5a-bec0-ac8a986fb504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107c7765-923d-4e5a-bec0-ac8a986fb504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd873e0-048f-42cf-90fc-869552b552a9', 'volume_name': 'volume-3fd873e0-048f-42cf-90fc-869552b552a9', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352adea1-f6a0-4816-b1b0-f41180346f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352adea1-f6a0-4816-b1b0-f41180346f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9caadd88-92fa-4136-a645-00caf602330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:23 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Volume 3fd873e0-048f-42cf-90fc-869552b552a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd873e0-048f-42cf-90fc-869552b552a9', 'volume_size': 1} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:23 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6" returned: 0 in 0.792s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.397s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-913077349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd873e0-048f-42cf-90fc-869552b552a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328df6dc157342b9891c51dfe89e7917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:51:23Z,use_quota=True,user_id='1d3ff38309354e33a948c7a01ad067bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Creating volume 3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:51:23 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:51:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:23 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 1073741824 Jun 03 14:51:23 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:23 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-bbdb202d-da01-4a7e-b5d7-f7155540492f tempest-SnapshotsActionsTest-515468414 None] Create snapshot completed successfully Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-6eb22385-86b0-4037-a368-c729700096a6-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-6eb22385-86b0-4037-a368-c729700096a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-quobyte-6eb22385-86b0-4037-a368-c729700096a6" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-6eb22385-86b0-4037-a368-c729700096a6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Deleting offline snapshot 6eb22385-86b0-4037-a368-c729700096a6 of volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:51:24 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] snapshot_file for this snap is: volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 1073741824" returned: 0 in 0.980s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=133,cinder:INSERT=43,cinder:UPDATE=122,cinder:DELETE=8 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[952cf7a4-2d09-4fd9-9de9-acb0ccda43cb]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:24 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 Jun 03 14:51:24 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:24 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 Jun 03 14:51:24 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:25 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9" returned: 0 in 0.682s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=143,cinder:SELECT=126,cinder:INSERT=44,cinder:DELETE=6 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9caadd88-92fa-4136-a645-00caf602330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd873e0-048f-42cf-90fc-869552b552a9', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ce971d-0784-42fa-8d29-46dc34249055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:25 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6" returned: 0 in 0.789s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:25 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Volume volume-3fd873e0-048f-42cf-90fc-869552b552a9 (3fd873e0-048f-42cf-90fc-869552b552a9): created successfully Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ce971d-0784-42fa-8d29-46dc34249055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Flow 'volume_create_manager' (56574a10-a90a-4a70-9ac7-9b29975cafb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8729580-be36-44d2-b61e-da70a67ced70]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-13ab94d9-c4b0-4a01-bb59-55ceea82d83c tempest-VolumeDependencyTests-245942766 None] Created volume successfully. Jun 03 14:51:25 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:51:25 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:26 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.722s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:26 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 Jun 03 14:51:26 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Creating offline snapshot 7609be6f-f9a3-4f5f-98bc-578664843830 of volume 3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:51:26 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[28273903-1350-4d97-b1b8-9728f966e1ab]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:26 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 Jun 03 14:51:26 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:26 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6" returned: 0 in 0.842s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:26 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6 Jun 03 14:51:26 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:27 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9" returned: 0 in 0.801s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:27 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 1G Jun 03 14:51:27 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:27 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.6eb22385-86b0-4037-a368-c729700096a6" returned: 0 in 0.696s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-6eb22385-86b0-4037-a368-c729700096a6" released by "_delete_snapshot" :: held 3.180s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" released by "delete_snapshot" :: held 3.205s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:27 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Created reservations ['68f1d719-abe4-4593-8681-b1aa1366e48b', '9ed1d076-ce95-4fdd-9733-6349be8a4c4d', '72bd6f7b-593b-42f9-bf54-2c4b6b962d4b', 'c9143fe6-f2fb-480d-be5d-b40f721f885a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:51:27 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Delete snapshot completed successfully. Jun 03 14:51:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2ebde39f-3c78-4f03-b324-8bee362e0e28 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-6eb22385-86b0-4037-a368-c729700096a6-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:28 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 1G" returned: 0 in 0.871s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fd873e0-048f-42cf-90fc-869552b552a9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:28 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fd873e0-048f-42cf-90fc-869552b552a9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 Jun 03 14:51:28 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:29 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fd873e0-048f-42cf-90fc-869552b552a9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830" returned: 0 in 0.792s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:29 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 is being set with open permissions: ugo+rw Jun 03 14:51:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:29 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 Jun 03 14:51:29 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:29 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830" returned: 0 in 0.636s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:29 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.info Jun 03 14:51:29 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-26a64267-bee7-4c21-bc2d-97a589fac427 req-daa541f8-a4b2-4c49-bb65-cfd732c39646 tempest-TestShelveInstance-686681569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:30 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.info" returned: 0 in 0.630s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:30 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.info is being set with open permissions: ugo+rw Jun 03 14:51:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:30 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.info Jun 03 14:51:30 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:30 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.info" returned: 0 in 0.575s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.414s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.868s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] Creating offline snapshot 3b9ace01-244a-4f60-a678-e17b33108d23 of volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:51:30 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d929c06b-498e-4ac1-86e1-879726f8c469 tempest-VolumeDependencyTests-245942766 None] Create snapshot completed successfully Jun 03 14:51:30 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[121723e0-813c-467a-8737-bd76d889cb41]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:31 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:51:31 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:31 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.694s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:31 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 1G Jun 03 14:51:31 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Flow 'volume_create_manager' (2b0fc332-8887-440b-bf40-fd7e2a5dd3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bac447-522f-47d4-ab36-6419cfbd144a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bac447-522f-47d4-ab36-6419cfbd144a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-672932825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0535be39-33d3-4fb6-80ec-2f7cb30d7e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328df6dc157342b9891c51dfe89e7917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7609be6f-f9a3-4f5f-98bc-578664843830,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:51:32Z,use_quota=True,user_id='1d3ff38309354e33a948c7a01ad067bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612191ef-1e99-4b26-b52c-446bcc94cfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612191ef-1e99-4b26-b52c-446bcc94cfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5922968f-438b-4cc0-aa4d-79e8799269d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5922968f-438b-4cc0-aa4d-79e8799269d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0535be39-33d3-4fb6-80ec-2f7cb30d7e98', 'volume_name': 'volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98', 'volume_size': 1, 'snapshot_id': '7609be6f-f9a3-4f5f-98bc-578664843830'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d83cc7e-32f6-4eb1-9334-bb6f451d2ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d83cc7e-32f6-4eb1-9334-bb6f451d2ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d5cbe5-cb9b-44cd-811d-b74f3fc13ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:32 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Volume 0535be39-33d3-4fb6-80ec-2f7cb30d7e98: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98', 'volume_size': 1, 'snapshot_id': '7609be6f-f9a3-4f5f-98bc-578664843830'} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:32 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 1G" returned: 0 in 1.271s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:32 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 Jun 03 14:51:32 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:33 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23" returned: 0 in 0.790s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:33 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 is being set with open permissions: ugo+rw Jun 03 14:51:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:33 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 Jun 03 14:51:33 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:34 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23" returned: 0 in 0.653s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.519s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-26a64267-bee7-4c21-bc2d-97a589fac427 req-daa541f8-a4b2-4c49-bb65-cfd732c39646 tempest-TestShelveInstance-686681569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.699s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:34 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-076d25b2-c64b-4d25-9cad-0b7d2ab214b9 tempest-SnapshotsActionsTest-515468414 None] Create snapshot completed successfully Jun 03 14:51:34 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d22894-7b92-40f6-824b-8aee122bb580]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-26a64267-bee7-4c21-bc2d-97a589fac427 req-daa541f8-a4b2-4c49-bb65-cfd732c39646 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:34 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:51:34 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:35 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-26a64267-bee7-4c21-bc2d-97a589fac427 req-daa541f8-a4b2-4c49-bb65-cfd732c39646 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 0 in 0.708s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-26a64267-bee7-4c21-bc2d-97a589fac427 req-daa541f8-a4b2-4c49-bb65-cfd732c39646 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:35 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:51:35 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-3b9ace01-244a-4f60-a678-e17b33108d23-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-3b9ace01-244a-4f60-a678-e17b33108d23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-quobyte-3b9ace01-244a-4f60-a678-e17b33108d23" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-3b9ace01-244a-4f60-a678-e17b33108d23" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Deleting offline snapshot 3b9ace01-244a-4f60-a678-e17b33108d23 of volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] snapshot_file for this snap is: volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[153fb8e3-249c-4554-827f-09b5cbfd5ead]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:35 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 Jun 03 14:51:35 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:35 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-26a64267-bee7-4c21-bc2d-97a589fac427 req-daa541f8-a4b2-4c49-bb65-cfd732c39646 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 1 in 0.793s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-26a64267-bee7-4c21-bc2d-97a589fac427 req-daa541f8-a4b2-4c49-bb65-cfd732c39646 tempest-TestShelveInstance-686681569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-26a64267-bee7-4c21-bc2d-97a589fac427 req-daa541f8-a4b2-4c49-bb65-cfd732c39646 tempest-TestShelveInstance-686681569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.545s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.359s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Acquiring lock "cinder-quobyte-7609be6f-f9a3-4f5f-98bc-578664843830-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" by "_create_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-7609be6f-f9a3-4f5f-98bc-578664843830-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Creating volume 0535be39-33d3-4fb6-80ec-2f7cb30d7e98 from snapshot 7609be6f-f9a3-4f5f-98bc-578664843830 {{(pid=86614) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Acquiring lock "cinder-quobyte-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] snapshot: 7609be6f-f9a3-4f5f-98bc-578664843830, volume: 0535be39-33d3-4fb6-80ec-2f7cb30d7e98, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-26a64267-bee7-4c21-bc2d-97a589fac427 req-daa541f8-a4b2-4c49-bb65-cfd732c39646 tempest-TestShelveInstance-686681569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df100ecc-9c11-44e0-878c-57c6b637b318', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6704457-b1d1-478a-a402-717cc1e476a5]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:36 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-26a64267-bee7-4c21-bc2d-97a589fac427 req-daa541f8-a4b2-4c49-bb65-cfd732c39646 tempest-TestShelveInstance-686681569 None] attachment_update completed successfully. Jun 03 14:51:36 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 Jun 03 14:51:36 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:36 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23" returned: 0 in 0.761s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cb788f-66f4-4d43-8257-8a1b981dcfa9]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:36 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:51:36 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:36 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830" returned: 0 in 0.777s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fd873e0-048f-42cf-90fc-869552b552a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f90c0-5db7-4fbe-b6f8-7fa4b933d25f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:37 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 Jun 03 14:51:37 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:37 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.798s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:37 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 Jun 03 14:51:37 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:37 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9" returned: 0 in 0.741s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:37 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 14:51:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:37 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 Jun 03 14:51:37 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:38 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23" returned: 0 in 0.784s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:38 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23 Jun 03 14:51:38 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:39 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.3b9ace01-244a-4f60-a678-e17b33108d23" returned: 0 in 1.012s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-3b9ace01-244a-4f60-a678-e17b33108d23" released by "_delete_snapshot" :: held 3.526s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" released by "delete_snapshot" :: held 3.566s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:39 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Created reservations ['2d566e12-ad23-4ad3-b84c-ecc346773dc8', '7ca90ba5-e7d1-4780-a0c1-2b866cf2b44f', '0f6409f1-8b08-4d16-b924-704fb7bd11f5', '09d30014-467f-4316-a51c-7edda527141d'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:51:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Delete snapshot completed successfully. Jun 03 14:51:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-40d3f06d-ec13-4881-8304-0521accf6583 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-3b9ace01-244a-4f60-a678-e17b33108d23-delete_snapshot" released by "delete_snapshot" :: held 4.037s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:47 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" returned: 0 in 9.864s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:47 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e99a2ff-88b1-499f-8a80-f340b265e538]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:47 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 Jun 03 14:51:47 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:49 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9" returned: 0 in 1.693s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:49 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9, size 1024.00 MB, duration 9.86 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:51:49 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Converted 1024.00 MB image at 103.80 MB/s Jun 03 14:51:49 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 is being set with open permissions: ugo+rw Jun 03 14:51:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:49 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 Jun 03 14:51:49 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:50 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" returned: 0 in 0.979s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" released by "_copy_volume_from_snapshot" :: held 14.190s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-7609be6f-f9a3-4f5f-98bc-578664843830-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" released by "_create_volume_from_snapshot" :: held 14.232s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.256s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.787s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] Creating offline snapshot 7d917d71-69c6-470c-8aa6-d930e4adb46b of volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d5cbe5-cb9b-44cd-811d-b74f3fc13ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98', 'volume_size': 1, 'snapshot_id': '7609be6f-f9a3-4f5f-98bc-578664843830'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffd0b9d-d312-42a9-95d9-49937af4e518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbcbbad-5ca7-4261-b59a-cc6441fa1c0c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:50 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Volume volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 (0535be39-33d3-4fb6-80ec-2f7cb30d7e98): created successfully Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffd0b9d-d312-42a9-95d9-49937af4e518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:51:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Flow 'volume_create_manager' (2b0fc332-8887-440b-bf40-fd7e2a5dd3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:51:50 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-73d19355-bf2b-4f6e-8673-13258010d5ac tempest-VolumeDependencyTests-245942766 None] Created volume successfully. Jun 03 14:51:50 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:51:50 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:51 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 1.144s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:51 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b 1G Jun 03 14:51:51 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Acquiring lock "cinder-7609be6f-f9a3-4f5f-98bc-578664843830-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Lock "cinder-7609be6f-f9a3-4f5f-98bc-578664843830-delete_snapshot" acquired by "delete_snapshot" :: waited 0.117s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Acquiring lock "cinder-quobyte-3fd873e0-048f-42cf-90fc-869552b552a9" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-3fd873e0-048f-42cf-90fc-869552b552a9" acquired by "delete_snapshot" :: waited 0.072s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Acquiring lock "cinder-quobyte-7609be6f-f9a3-4f5f-98bc-578664843830" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-7609be6f-f9a3-4f5f-98bc-578664843830" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Deleting offline snapshot 7609be6f-f9a3-4f5f-98bc-578664843830 of volume 3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:51:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] snapshot_file for this snap is: volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:51:52 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8be7d97-6e16-4a4c-987f-04e6fda13cdd]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:52 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 Jun 03 14:51:52 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:52 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b 1G" returned: 0 in 1.105s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:52 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b Jun 03 14:51:52 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:53 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830" returned: 0 in 1.006s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fd873e0-048f-42cf-90fc-869552b552a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[829d1cd8-e9c2-4494-89c9-5090f3909d06]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:53 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 Jun 03 14:51:53 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:53 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b" returned: 0 in 0.939s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:53 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b is being set with open permissions: ugo+rw Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:53 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b Jun 03 14:51:53 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:53 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:51:53 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:54 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9" returned: 0 in 1.351s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:54 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 Jun 03 14:51:54 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:54 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.841s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:51:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:51:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:51:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:51:54 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b" returned: 0 in 1.049s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.455s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:54 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ed792d00-5a8e-4613-88ca-2bb5e0050163 tempest-SnapshotsActionsTest-515468414 None] Create snapshot completed successfully Jun 03 14:51:55 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830" returned: 0 in 0.766s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:55 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830 Jun 03 14:51:55 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:55 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9.7609be6f-f9a3-4f5f-98bc-578664843830" returned: 0 in 0.613s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-7609be6f-f9a3-4f5f-98bc-578664843830" released by "_delete_snapshot" :: held 3.882s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-3fd873e0-048f-42cf-90fc-869552b552a9" released by "delete_snapshot" :: held 3.945s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Created reservations ['5ea645ed-91b3-4c03-97ce-12e7979bda15', 'fa94c106-8757-49ec-b0b0-16ca04eb8b85', 'a8b78025-6ae6-4315-b833-d797afc0410c', 'e4873ca5-7f21-4d4a-9b79-a7ddfb2fe218'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-7d917d71-69c6-470c-8aa6-d930e4adb46b-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-7d917d71-69c6-470c-8aa6-d930e4adb46b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-quobyte-7d917d71-69c6-470c-8aa6-d930e4adb46b" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-7d917d71-69c6-470c-8aa6-d930e4adb46b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Deleting offline snapshot 7d917d71-69c6-470c-8aa6-d930e4adb46b of volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] snapshot_file for this snap is: volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Acquiring lock "cinder-3fd873e0-048f-42cf-90fc-869552b552a9-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e41f483-9b09-4b18-8b1c-321197cea6cd]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Lock "cinder-3fd873e0-048f-42cf-90fc-869552b552a9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Delete snapshot completed successfully. Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8bf37f44-7fe3-4f68-825e-7caa7eb649a0 tempest-VolumeDependencyTests-245942766 None] Lock "cinder-7609be6f-f9a3-4f5f-98bc-578664843830-delete_snapshot" released by "delete_snapshot" :: held 4.302s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Acquiring lock "cinder-quobyte-3fd873e0-048f-42cf-90fc-869552b552a9" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-3fd873e0-048f-42cf-90fc-869552b552a9" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:56 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b Jun 03 14:51:56 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bb97e7-fdf2-4eee-84c3-17e76a5701ce]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:56 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 Jun 03 14:51:56 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:56 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b" returned: 0 in 0.784s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe3f3c6-fe63-4a0c-84aa-31e4f312b84c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:56 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9" returned: 0 in 0.738s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:57 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9 Jun 03 14:51:57 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:57 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:51:57 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:57 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3fd873e0-048f-42cf-90fc-869552b552a9" returned: 0 in 0.606s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-3fd873e0-048f-42cf-90fc-869552b552a9" released by "delete_volume" :: held 1.440s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:57 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.730s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:57 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b Jun 03 14:51:57 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Created reservations ['ed376e89-eab6-42b3-992a-5e5ddf664118', '19ef4f37-6142-4c58-8e53-db087c86669e', 'cf25695d-f7c8-4074-8691-aa5aaa8cf9f3', 'c79e156b-aff3-4e2a-9b5a-5d1340dc000f'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:51:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:57 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:51:57 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Acquiring lock "cinder-0535be39-33d3-4fb6-80ec-2f7cb30d7e98-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Lock "cinder-0535be39-33d3-4fb6-80ec-2f7cb30d7e98-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:58 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b" returned: 0 in 0.872s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:58 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.795s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:51:58 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b Jun 03 14:51:58 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Acquiring lock "cinder-quobyte-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:51:58 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Deleted volume successfully. Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-02974028-94e9-47c2-b2d5-a023419c66fc tempest-VolumeDependencyTests-245942766 None] Lock "cinder-3fd873e0-048f-42cf-90fc-869552b552a9-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0bd98d-d203-4b58-9403-d93adc6648eb]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:51:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:58 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 Jun 03 14:51:58 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:51:59 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.7d917d71-69c6-470c-8aa6-d930e4adb46b" returned: 0 in 0.629s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-7d917d71-69c6-470c-8aa6-d930e4adb46b" released by "_delete_snapshot" :: held 3.149s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" released by "delete_snapshot" :: held 3.184s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:59 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Created reservations ['0813724f-d9ae-49d9-9331-4c833c36d964', '8ceb1532-b106-4855-86d7-0338d6936931', '3010dd4a-c38e-47f8-b534-08e34c6686d3', 'eec0306d-33a4-4e2e-b528-9071a1041501'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:51:59 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Delete snapshot completed successfully. Jun 03 14:51:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-25399e86-cb47-4556-8ce5-21fd869c58f3 tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-7d917d71-69c6-470c-8aa6-d930e4adb46b-delete_snapshot" released by "delete_snapshot" :: held 3.344s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:51:59 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jun 03 14:51:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" returned: 0 in 0.781s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:51:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:51:59 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98 Jun 03 14:51:59 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:00 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" returned: 0 in 0.605s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Lock "cinder-quobyte-0535be39-33d3-4fb6-80ec-2f7cb30d7e98" released by "delete_volume" :: held 1.437s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Created reservations ['1e3cdcea-4208-485f-b1f2-cc10cf2464dd', 'b6ea424f-fb73-45cb-8215-96a8b60d219b', '8eb6eb15-b2c5-434c-845a-cafdf90a0aff', 'aba51092-1a26-486d-b64e-9622c128a7f1'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:00 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:52:00 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] Creating offline snapshot 01e83364-d5d2-40da-9f83-3b9de1d7fe36 of volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[f411cb57-3df8-41b9-928b-f9ed2b2da3fa]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:00 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:52:00 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:00 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.768s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:52:00 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Deleted volume successfully. Jun 03 14:52:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cc644d2c-e405-4976-bfb4-6743381286a3 tempest-VolumeDependencyTests-245942766 None] Lock "cinder-0535be39-33d3-4fb6-80ec-2f7cb30d7e98-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:01 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.992s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:52:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:01 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 1G Jun 03 14:52:01 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:02 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 1G" returned: 0 in 1.220s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:02 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 Jun 03 14:52:02 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:03 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36" returned: 0 in 0.657s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:03 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 is being set with open permissions: ugo+rw Jun 03 14:52:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:03 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 Jun 03 14:52:03 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:04 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36" returned: 0 in 0.606s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.618s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:04 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a733f70d-47e1-4499-bb6b-c0dc86027335 tempest-SnapshotsActionsTest-515468414 None] Create snapshot completed successfully Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-01e83364-d5d2-40da-9f83-3b9de1d7fe36-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-01e83364-d5d2-40da-9f83-3b9de1d7fe36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Acquiring lock "cinder-quobyte-01e83364-d5d2-40da-9f83-3b9de1d7fe36" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-01e83364-d5d2-40da-9f83-3b9de1d7fe36" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Deleting offline snapshot 01e83364-d5d2-40da-9f83-3b9de1d7fe36 of volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] snapshot_file for this snap is: volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3c652b-16be-4c7a-a55f-d6d50fc9fd30]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:52:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:05 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 Jun 03 14:52:05 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:05 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36" returned: 0 in 0.700s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:52:05 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2ec19e-92a1-4615-8cc5-b2c460baeb9e]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:52:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:05 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:52:05 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:06 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.693s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:06 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:52:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:06 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 Jun 03 14:52:06 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:07 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36" returned: 0 in 0.703s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:07 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36 Jun 03 14:52:07 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:07 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.01e83364-d5d2-40da-9f83-3b9de1d7fe36" returned: 0 in 0.588s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-01e83364-d5d2-40da-9f83-3b9de1d7fe36" released by "_delete_snapshot" :: held 2.776s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" released by "delete_snapshot" :: held 2.801s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:07 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Created reservations ['afcd8ec2-41f8-42f3-89d2-cc32861e7256', '421e478e-77f2-4e80-acda-5fff2b7fb79c', '9f614427-7662-4fd3-91a2-387351600824', '8e241204-37fa-418a-a5ac-b7115b4b3f7d'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:52:07 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Delete snapshot completed successfully. Jun 03 14:52:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b863d6d2-74d6-4482-9d8e-c60620deff3f tempest-SnapshotsActionsTest-385082907 None] Lock "cinder-01e83364-d5d2-40da-9f83-3b9de1d7fe36-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "cinder-e846ca2f-49ba-4a02-bcaa-a1670dc6c189-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Lock "cinder-e846ca2f-49ba-4a02-bcaa-a1670dc6c189-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "cinder-quobyte-e846ca2f-49ba-4a02-bcaa-a1670dc6c189" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Lock "cinder-quobyte-e846ca2f-49ba-4a02-bcaa-a1670dc6c189" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Deleting offline snapshot e846ca2f-49ba-4a02-bcaa-a1670dc6c189 of volume 514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] snapshot_file for this snap is: volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[763a826b-69dd-4437-ad21-4199ff584bc9]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:08 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:52:08 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Flow 'volume_create_manager' (c18d1f22-14c2-47eb-9367-8a5b3d9be90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf108b0e-2b61-46eb-a9bb-d59ffd74f4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf108b0e-2b61-46eb-a9bb-d59ffd74f4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1981813656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f43c07d-c47a-4f9a-9d41-809f2858a323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe63bdd834684039b19fd6e49d40f1da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:52:09Z,use_quota=True,user_id='097bf913b6c14abfb4c838d10b891c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce3a61b-2a26-4962-af93-a05b867f7ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce3a61b-2a26-4962-af93-a05b867f7ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f901aa5-96f9-47cb-b1df-4dee5e98fcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f901aa5-96f9-47cb-b1df-4dee5e98fcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f43c07d-c47a-4f9a-9d41-809f2858a323', 'volume_name': 'volume-8f43c07d-c47a-4f9a-9d41-809f2858a323', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b392f534-f73b-411e-883a-7403ec23b88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b392f534-f73b-411e-883a-7403ec23b88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb22d09-7967-44ae-be06-2b7739c68377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:08 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Volume 8f43c07d-c47a-4f9a-9d41-809f2858a323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f43c07d-c47a-4f9a-9d41-809f2858a323', 'volume_size': 1} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1981813656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f43c07d-c47a-4f9a-9d41-809f2858a323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe63bdd834684039b19fd6e49d40f1da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:52:09Z,use_quota=True,user_id='097bf913b6c14abfb4c838d10b891c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Creating volume 8f43c07d-c47a-4f9a-9d41-809f2858a323 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:52:08 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:52:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:08 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323 1073741824 Jun 03 14:52:08 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:09 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.740s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514f53e4-5432-4b53-a215-924a0c15f602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:52:09 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af44708-fa78-40ab-a267-281b981dab47]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:52:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:09 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 Jun 03 14:52:09 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:09 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323 1073741824" returned: 0 in 0.894s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:09 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323 Jun 03 14:52:09 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:10 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602" returned: 0 in 0.797s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:10 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:52:10 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:10 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323" returned: 0 in 0.622s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb22d09-7967-44ae-be06-2b7739c68377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f43c07d-c47a-4f9a-9d41-809f2858a323', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056f1327-39d6-47f9-88f0-232cc996673d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:10 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Volume volume-8f43c07d-c47a-4f9a-9d41-809f2858a323 (8f43c07d-c47a-4f9a-9d41-809f2858a323): created successfully Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056f1327-39d6-47f9-88f0-232cc996673d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Flow 'volume_create_manager' (c18d1f22-14c2-47eb-9367-8a5b3d9be90f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:52:10 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7ae95280-3464-4988-a81f-1db97989e0eb tempest-AttachVolumeShelveTestJSON-149926842 None] Created volume successfully. Jun 03 14:52:10 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.723s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:10 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189 Jun 03 14:52:10 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:11 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602.e846ca2f-49ba-4a02-bcaa-a1670dc6c189" returned: 0 in 0.646s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Lock "cinder-quobyte-e846ca2f-49ba-4a02-bcaa-a1670dc6c189" released by "_delete_snapshot" :: held 3.038s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" released by "delete_snapshot" :: held 3.063s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:11 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Created reservations ['ba8986b7-0712-45b4-ac8b-84c2c1db01a9', '6446b5c0-e57d-4926-af09-9b3f07a794b7', '85c90c5e-3510-438d-9de7-ee35614d951b', '60a36dcc-6e49-4ef6-b8f1-b5fe6f34b7b5'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:52:11 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Delete snapshot completed successfully. Jun 03 14:52:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2522b166-06d6-4e50-b11b-e78305ec0fab tempest-SnapshotsActionsTest-515468414 None] Lock "cinder-e846ca2f-49ba-4a02-bcaa-a1670dc6c189-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "cinder-514f53e4-5432-4b53-a215-924a0c15f602-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Lock "cinder-514f53e4-5432-4b53-a215-924a0c15f602-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" acquired by "delete_volume" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:12 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[222db1e6-7d04-4ba6-8024-21a3a8761111]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:52:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:12 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 Jun 03 14:52:12 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:13 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602" returned: 0 in 0.712s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:13 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602 Jun 03 14:52:13 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:14 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-514f53e4-5432-4b53-a215-924a0c15f602" returned: 0 in 0.706s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Lock "cinder-quobyte-514f53e4-5432-4b53-a215-924a0c15f602" released by "delete_volume" :: held 1.492s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:14 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Created reservations ['967dc387-c70f-48c3-b0cb-d31f1525850d', 'fde98969-fbca-4e67-aee3-3863945fa0dc', '8ccd211d-c035-42be-ab1a-2c04b77a6067', 'fb804078-5669-4852-82f6-6f9ee706f38d'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:52:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:52:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:52:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:14 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:52:14 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:15 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.685s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:15 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:52:15 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Deleted volume successfully. Jun 03 14:52:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-04384f51-48ed-4ba1-a200-91412a3b56b6 tempest-SnapshotsActionsTest-515468414 None] Lock "cinder-514f53e4-5432-4b53-a215-924a0c15f602-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:19 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-a04b41b2-fc32-40e2-a0f9-59e21befb347 req-ed4a45c0-5c5e-4141-92fd-188d53c5a1c7 tempest-TestShelveInstance-686681569 None] Terminate volume connection completed successfully. Jun 03 14:52:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-a04b41b2-fc32-40e2-a0f9-59e21befb347 req-ed4a45c0-5c5e-4141-92fd-188d53c5a1c7 tempest-TestShelveInstance-686681569 None] Deleting attachment df100ecc-9c11-44e0-878c-57c6b637b318. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Flow 'volume_create_manager' (0ba03b5a-6c2d-45b7-993f-662c4621f19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b22c67-3dbd-4f05-8466-b60b0448e030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b22c67-3dbd-4f05-8466-b60b0448e030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1099377550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33003e82-ca9e-4bd5-af02-a10a743d6e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4d76e6b9a6b466fbec1cd3aaa889df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:52:20Z,use_quota=True,user_id='c4ff20b49a6f4cf3ae1bc84ecf8de26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dec5bb-3863-4cf3-88dc-31a4864f1952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dec5bb-3863-4cf3-88dc-31a4864f1952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aabf719-6584-40df-98a6-10df7261a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aabf719-6584-40df-98a6-10df7261a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33003e82-ca9e-4bd5-af02-a10a743d6e32', 'volume_name': 'volume-33003e82-ca9e-4bd5-af02-a10a743d6e32', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4774b24-6ebc-4b35-b2b7-5a142c19f3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4774b24-6ebc-4b35-b2b7-5a142c19f3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7992f549-b660-4271-8aef-ea7fd183adb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:20 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Volume 33003e82-ca9e-4bd5-af02-a10a743d6e32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33003e82-ca9e-4bd5-af02-a10a743d6e32', 'volume_size': 1} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1099377550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33003e82-ca9e-4bd5-af02-a10a743d6e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4d76e6b9a6b466fbec1cd3aaa889df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:52:20Z,use_quota=True,user_id='c4ff20b49a6f4cf3ae1bc84ecf8de26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Creating volume 33003e82-ca9e-4bd5-af02-a10a743d6e32 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:52:20 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:52:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:20 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32 1073741824 Jun 03 14:52:20 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:21 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32 1073741824" returned: 0 in 0.860s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:21 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32 Jun 03 14:52:21 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:21 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32" returned: 0 in 0.621s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:52:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7992f549-b660-4271-8aef-ea7fd183adb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33003e82-ca9e-4bd5-af02-a10a743d6e32', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ee5ae4-8ce1-44c8-a508-e1ec202acdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:22 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Volume volume-33003e82-ca9e-4bd5-af02-a10a743d6e32 (33003e82-ca9e-4bd5-af02-a10a743d6e32): created successfully Jun 03 14:52:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ee5ae4-8ce1-44c8-a508-e1ec202acdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Flow 'volume_create_manager' (0ba03b5a-6c2d-45b7-993f-662c4621f19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:52:22 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-27901e7b-0a9c-4aab-a13a-126946f91d9c tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Created volume successfully. Jun 03 14:52:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Acquiring lock "cinder-33003e82-ca9e-4bd5-af02-a10a743d6e32-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Lock "cinder-33003e82-ca9e-4bd5-af02-a10a743d6e32-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Acquiring lock "cinder-quobyte-33003e82-ca9e-4bd5-af02-a10a743d6e32" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Lock "cinder-quobyte-33003e82-ca9e-4bd5-af02-a10a743d6e32" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:23 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ceaae5-93c7-41e3-8b75-999e4da5d84b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:52:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:23 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32 Jun 03 14:52:23 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-1bf2de5f-1fa4-41c7-a7e5-c1526a7922cf req-ba226440-7451-4401-b8d0-452f7cc2ef71 tempest-TestShelveInstance-686681569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-1bf2de5f-1fa4-41c7-a7e5-c1526a7922cf req-ba226440-7451-4401-b8d0-452f7cc2ef71 tempest-TestShelveInstance-686681569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[87071c42-81d8-41ae-8bd9-ea324640b923]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-1bf2de5f-1fa4-41c7-a7e5-c1526a7922cf req-ba226440-7451-4401-b8d0-452f7cc2ef71 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:24 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32" returned: 0 in 0.756s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:24 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:52:24 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:24 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32 Jun 03 14:52:24 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:24 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-33003e82-ca9e-4bd5-af02-a10a743d6e32" returned: 0 in 0.615s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:24 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Lock "cinder-quobyte-33003e82-ca9e-4bd5-af02-a10a743d6e32" released by "delete_volume" :: held 1.421s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-1bf2de5f-1fa4-41c7-a7e5-c1526a7922cf req-ba226440-7451-4401-b8d0-452f7cc2ef71 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 0 in 0.737s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-1bf2de5f-1fa4-41c7-a7e5-c1526a7922cf req-ba226440-7451-4401-b8d0-452f7cc2ef71 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=72,cinder:DELETE=6,cinder:SELECT=62,cinder:INSERT=20 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:52:24 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Created reservations ['09fb6b7d-f0f8-4f48-b7b6-169b1294b182', 'c884d9bc-9735-40f2-af46-451b75660ae4', 'b7d2b250-c236-4419-86f4-273f44292b10', '213e1318-e860-44b4-afa1-005d1880cb00'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:25 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:52:25 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:25 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:52:25 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:25 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.591s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:52:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Deleted volume successfully. Jun 03 14:52:25 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=84,cinder:SELECT=84,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-1bf2de5f-1fa4-41c7-a7e5-c1526a7922cf req-ba226440-7451-4401-b8d0-452f7cc2ef71 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 1 in 0.743s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-1bf2de5f-1fa4-41c7-a7e5-c1526a7922cf req-ba226440-7451-4401-b8d0-452f7cc2ef71 tempest-TestShelveInstance-686681569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-1bf2de5f-1fa4-41c7-a7e5-c1526a7922cf req-ba226440-7451-4401-b8d0-452f7cc2ef71 tempest-TestShelveInstance-686681569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.519s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c9dd71cb-b401-4fd3-8344-c062a3b18821 tempest-VolumeQuotasNegativeTestJSON-1702628253 None] Lock "cinder-33003e82-ca9e-4bd5-af02-a10a743d6e32-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-1bf2de5f-1fa4-41c7-a7e5-c1526a7922cf req-ba226440-7451-4401-b8d0-452f7cc2ef71 tempest-TestShelveInstance-686681569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f673b809-0bbc-416b-b6d6-d2b9c8756245', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:52:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-1bf2de5f-1fa4-41c7-a7e5-c1526a7922cf req-ba226440-7451-4401-b8d0-452f7cc2ef71 tempest-TestShelveInstance-686681569 None] attachment_update completed successfully. Jun 03 14:52:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-256282d2-9bfb-495b-a304-7340d0ee2504 req-9636cb2c-39e8-4bec-9731-415a05c71e04 tempest-AttachVolumeShelveTestJSON-149926842 None] No connector for attachment 1c3270eb-d505-4aca-a61b-433511d59aa4; skipping storage backend terminate_connection call. {{(pid=86614) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}} Jun 03 14:52:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-256282d2-9bfb-495b-a304-7340d0ee2504 req-9636cb2c-39e8-4bec-9731-415a05c71e04 tempest-AttachVolumeShelveTestJSON-149926842 None] Deleting attachment 1c3270eb-d505-4aca-a61b-433511d59aa4. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Flow 'volume_create_manager' (011efb1b-ee9a-413a-b2ce-9ff0266917c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3510de-2701-4db8-9247-93329e89058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3510de-2701-4db8-9247-93329e89058b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-513768986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6efa497-07f4-4b50-8a08-28ef5326b0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733a0656f744892b8986aae31880fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:52:36Z,use_quota=True,user_id='0e78c163c9f344919de908974457087f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba57ccbc-5f93-4300-9d8d-a26e57ecc3a3),volume_type_id=ba57ccbc-5f93-4300-9d8d-a26e57ecc3a3)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990c7097-c727-42fe-b579-a754b539a2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990c7097-c727-42fe-b579-a754b539a2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff129ef8-1824-4120-81e0-648d43689ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff129ef8-1824-4120-81e0-648d43689ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6efa497-07f4-4b50-8a08-28ef5326b0d7', 'volume_name': 'volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5394419f-dbfc-4073-9104-61a91d6a8a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5394419f-dbfc-4073-9104-61a91d6a8a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd2236e-05db-42a5-b46e-30023647d383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:36 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Volume b6efa497-07f4-4b50-8a08-28ef5326b0d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7', 'volume_size': 1} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-513768986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6efa497-07f4-4b50-8a08-28ef5326b0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733a0656f744892b8986aae31880fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:52:36Z,use_quota=True,user_id='0e78c163c9f344919de908974457087f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba57ccbc-5f93-4300-9d8d-a26e57ecc3a3),volume_type_id=ba57ccbc-5f93-4300-9d8d-a26e57ecc3a3)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Creating volume b6efa497-07f4-4b50-8a08-28ef5326b0d7 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:52:36 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:52:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:36 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7 1073741824 Jun 03 14:52:36 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:37 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7 1073741824" returned: 0 in 1.578s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:38 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7 Jun 03 14:52:38 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:38 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7" returned: 0 in 0.760s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] <== create_volume: return (2408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:52:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.410s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd2236e-05db-42a5-b46e-30023647d383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73216957-5945-472e-bc66-121c5a2b3bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:52:38 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Volume volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7 (b6efa497-07f4-4b50-8a08-28ef5326b0d7): created successfully Jun 03 14:52:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73216957-5945-472e-bc66-121c5a2b3bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:52:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Flow 'volume_create_manager' (011efb1b-ee9a-413a-b2ce-9ff0266917c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:52:38 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-856b6607-2c0d-4cbb-9601-af19e2199439 tempest-VolumeTypesAccessTest-869846024 None] Created volume successfully. Jun 03 14:52:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Acquiring lock "cinder-b6efa497-07f4-4b50-8a08-28ef5326b0d7-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Lock "cinder-b6efa497-07f4-4b50-8a08-28ef5326b0d7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Acquiring lock "cinder-quobyte-b6efa497-07f4-4b50-8a08-28ef5326b0d7" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:52:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Lock "cinder-quobyte-b6efa497-07f4-4b50-8a08-28ef5326b0d7" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:52:39 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7007fa7f-3bda-47b9-8e4e-e7ee776d4e54]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:52:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:39 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7 Jun 03 14:52:39 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:40 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7" returned: 0 in 0.790s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:40 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7 Jun 03 14:52:40 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:41 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b6efa497-07f4-4b50-8a08-28ef5326b0d7" returned: 0 in 0.638s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Lock "cinder-quobyte-b6efa497-07f4-4b50-8a08-28ef5326b0d7" released by "delete_volume" :: held 1.488s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:41 devstack cinder-volume[86614]: WARNING cinder.quota [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2141914675 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2141914675, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:52:41 devstack cinder-volume[86614]: WARNING cinder.quota [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2141914675 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2141914675, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:52:41 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Created reservations ['1aadd31d-562d-4309-9fb2-a7ea95300abc', '2a02cdc3-5299-4479-b7d2-41b5c852e0d4', 'b0d75d22-eee0-4f16-9cd0-051b339bcea2', '2598898b-a36a-4ab0-975d-c7425b3bda42'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:52:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:52:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:52:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:41 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:52:41 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:42 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.762s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:42 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:52:42 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Deleted volume successfully. Jun 03 14:52:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ebe76433-f3b6-4e22-8851-5927142611dd tempest-VolumeTypesAccessTest-869846024 None] Lock "cinder-b6efa497-07f4-4b50-8a08-28ef5326b0d7-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:52:51 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:52:52 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:52:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:52:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:52:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:52:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:52:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:52:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:52:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:52:53 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:52:53 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:52:54 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jun 03 14:52:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.618s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:52:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:52:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:52:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:52:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:53:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "cinder-8f43c07d-c47a-4f9a-9d41-809f2858a323-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "cinder-8f43c07d-c47a-4f9a-9d41-809f2858a323-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "cinder-quobyte-8f43c07d-c47a-4f9a-9d41-809f2858a323" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "cinder-quobyte-8f43c07d-c47a-4f9a-9d41-809f2858a323" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:16 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7713b1fd-0ed9-4678-bba1-099ffd09835f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:53:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:16 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323 Jun 03 14:53:16 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:17 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323" returned: 0 in 0.873s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:17 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323 Jun 03 14:53:17 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f43c07d-c47a-4f9a-9d41-809f2858a323" returned: 0 in 0.625s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:17 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "cinder-quobyte-8f43c07d-c47a-4f9a-9d41-809f2858a323" released by "delete_volume" :: held 1.592s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Created reservations ['18ae995f-1330-44cb-940e-d8b6a83fa58a', 'dcbfb6a8-78d0-4a6c-8845-bd33122c8472', '74a47ce4-937f-4387-b288-82eb4e19d945', '4e490801-9605-48ae-8aef-ac1572427ec7'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:18 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:53:18 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "cinder-289166f5-8378-4469-95d5-a30f978ce116-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "cinder-289166f5-8378-4469-95d5-a30f978ce116-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "cinder-quobyte-289166f5-8378-4469-95d5-a30f978ce116" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "cinder-quobyte-289166f5-8378-4469-95d5-a30f978ce116" acquired by "delete_volume" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5de9b27-08d2-4fff-a36a-5ef2b552a4e8]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:53:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:19 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.732s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:19 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:53:19 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Deleted volume successfully. Jun 03 14:53:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f104b592-8bee-4634-87e6-53435bb573b8 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "cinder-8f43c07d-c47a-4f9a-9d41-809f2858a323-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:19 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 Jun 03 14:53:19 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:19 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116" returned: 0 in 0.787s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:19 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116 Jun 03 14:53:19 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:20 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-289166f5-8378-4469-95d5-a30f978ce116" returned: 0 in 0.641s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "cinder-quobyte-289166f5-8378-4469-95d5-a30f978ce116" released by "delete_volume" :: held 1.507s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:20 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Created reservations ['3cefada7-889d-46f9-b662-af587e14715c', 'afd57d26-c6f7-44cd-a044-7a404337a973', '86216915-bc5f-4ac8-bd43-2140d94ff4e3', '7c041976-54dc-4b01-ba83-50bc3cb88f1e'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:53:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:53:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:53:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:20 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:53:20 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:21 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.602s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:21 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:53:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Deleted volume successfully. Jun 03 14:53:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fe7cd104-66fe-46a2-bd7a-dba70d4491d1 tempest-AttachVolumeShelveTestJSON-149926842 None] Lock "cinder-289166f5-8378-4469-95d5-a30f978ce116-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-770952bd-aec3-4049-92b4-912853896c61 tempest-TestShelveInstance-686681569 None] Terminate volume connection completed successfully. Jun 03 14:53:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-770952bd-aec3-4049-92b4-912853896c61 tempest-TestShelveInstance-686681569 None] Deleting attachment f673b809-0bbc-416b-b6d6-d2b9c8756245. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:53:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Acquiring lock "cinder-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Lock "cinder-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Acquiring lock "cinder-quobyte-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Lock "cinder-quobyte-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:21 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab935c2d-7bb1-43a1-afde-4fe9862d490f]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:53:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:22 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:53:22 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:22 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 0 in 0.842s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:22 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:53:22 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:23 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 1 in 0.860s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:53:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:23 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2 Jun 03 14:53:23 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:24 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" returned: 0 in 0.742s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Lock "cinder-quobyte-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2" released by "delete_volume" :: held 2.522s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:24 devstack cinder-volume[86614]: DEBUG cinder.quota [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Created reservations ['b8c17aab-a806-4b3d-ac24-b31feb399129', '3bb4647a-404e-4b42-97c5-6e2e6508d1b3', '9a51d4c4-92ed-4b82-9093-789cbe00096e', '4570bb86-1c2f-492f-bb8a-d2272c678fab'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:53:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:53:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:53:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:24 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:53:24 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:25 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.752s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:25 devstack cinder-volume[86614]: DEBUG cinder.manager [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:53:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Deleted volume successfully. Jun 03 14:53:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [req-3713f921-0567-4b1d-ad49-c2d603bfcf3a req-10ed0b7d-c63a-403c-9bf6-99166e776f77 tempest-TestShelveInstance-686681569 None] Lock "cinder-85ce26e5-a8e0-4e7b-8a49-dccfe8dcb9d2-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (c310399f-68b8-4268-a404-69f27f6a012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084880dc-9add-4fc2-83b6-6614bb155c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084880dc-9add-4fc2-83b6-6614bb155c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-220189183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a23c71-ae83-45f4-8894-12354931e340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:53:34Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc11a60-da82-43be-8dbb-0a3bbf091082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc11a60-da82-43be-8dbb-0a3bbf091082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5f0744-6040-4455-9766-9d6cfb127cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5f0744-6040-4455-9766-9d6cfb127cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a23c71-ae83-45f4-8894-12354931e340', 'volume_name': 'volume-21a23c71-ae83-45f4-8894-12354931e340', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c436b9e8-6e44-4f8b-bd06-194abea97a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c436b9e8-6e44-4f8b-bd06-194abea97a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a1b4bc-9b87-4286-8a07-84c75cb84cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:34 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Volume 21a23c71-ae83-45f4-8894-12354931e340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a23c71-ae83-45f4-8894-12354931e340', 'volume_size': 1} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-220189183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a23c71-ae83-45f4-8894-12354931e340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:53:34Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Creating volume 21a23c71-ae83-45f4-8894-12354931e340 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:53:34 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:53:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:34 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340 1073741824 Jun 03 14:53:34 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:35 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=21,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:53:35 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340 1073741824" returned: 0 in 1.315s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:35 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340 Jun 03 14:53:35 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:36 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340" returned: 0 in 1.106s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] <== create_volume: return (2484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:53:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.490s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a1b4bc-9b87-4286-8a07-84c75cb84cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a23c71-ae83-45f4-8894-12354931e340', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb88e10-49a4-4e39-9d7a-88b3def68757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:37 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Volume volume-21a23c71-ae83-45f4-8894-12354931e340 (21a23c71-ae83-45f4-8894-12354931e340): created successfully Jun 03 14:53:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb88e10-49a4-4e39-9d7a-88b3def68757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (c310399f-68b8-4268-a404-69f27f6a012b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:53:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-48c6a425-04b3-488e-803e-b170d1275912 tempest-VolumesActionsTest-1845685600 None] Created volume successfully. Jun 03 14:53:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-303997f4-2eb2-41f5-a437-396e72097e93 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "cinder-21a23c71-ae83-45f4-8894-12354931e340" by "attach_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-303997f4-2eb2-41f5-a437-396e72097e93 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-21a23c71-ae83-45f4-8894-12354931e340" acquired by "attach_volume" :: waited 0.031s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-303997f4-2eb2-41f5-a437-396e72097e93 tempest-VolumesActionsTest-1845685600 None] Attaching volume 21a23c71-ae83-45f4-8894-12354931e340 to instance 70eb3824-4cd5-49f1-8b8d-0b735cdd2f3c at mountpoint /dev/vdb on host None. Jun 03 14:53:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-303997f4-2eb2-41f5-a437-396e72097e93 tempest-VolumesActionsTest-1845685600 None] Attach volume completed successfully. Jun 03 14:53:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-303997f4-2eb2-41f5-a437-396e72097e93 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-21a23c71-ae83-45f4-8894-12354931e340" released by "attach_volume" :: held 0.153s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e12631f7-40ce-48b8-b708-ad4b4c1de896 tempest-VolumesActionsTest-1932174973 None] Terminate volume connection completed successfully. Jun 03 14:53:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e12631f7-40ce-48b8-b708-ad4b4c1de896 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "cinder-21a23c71-ae83-45f4-8894-12354931e340-detach_volume" by "detach_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e12631f7-40ce-48b8-b708-ad4b4c1de896 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-21a23c71-ae83-45f4-8894-12354931e340-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e12631f7-40ce-48b8-b708-ad4b4c1de896 tempest-VolumesActionsTest-1932174973 None] Detaching volume 21a23c71-ae83-45f4-8894-12354931e340 from instance 70eb3824-4cd5-49f1-8b8d-0b735cdd2f3c. Jun 03 14:53:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e12631f7-40ce-48b8-b708-ad4b4c1de896 tempest-VolumesActionsTest-1932174973 None] Detach volume completed successfully. Jun 03 14:53:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e12631f7-40ce-48b8-b708-ad4b4c1de896 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-21a23c71-ae83-45f4-8894-12354931e340-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f3166f95-b0a1-4402-b2f1-8ac95ba8ffe2 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "cinder-21a23c71-ae83-45f4-8894-12354931e340-detach_volume" by "detach_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f3166f95-b0a1-4402-b2f1-8ac95ba8ffe2 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-21a23c71-ae83-45f4-8894-12354931e340-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:40 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f3166f95-b0a1-4402-b2f1-8ac95ba8ffe2 tempest-VolumesActionsTest-1845685600 None] Volume detach called, but volume not attached. Jun 03 14:53:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f3166f95-b0a1-4402-b2f1-8ac95ba8ffe2 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-21a23c71-ae83-45f4-8894-12354931e340-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "cinder-21a23c71-ae83-45f4-8894-12354931e340-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-21a23c71-ae83-45f4-8894-12354931e340-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "cinder-quobyte-21a23c71-ae83-45f4-8894-12354931e340" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-quobyte-21a23c71-ae83-45f4-8894-12354931e340" acquired by "delete_volume" :: waited 0.039s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:41 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1b1c5d-9f2f-4708-919c-061d3c53aef9]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:53:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:41 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340 Jun 03 14:53:41 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:42 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340" returned: 0 in 1.101s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:42 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340 Jun 03 14:53:42 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:43 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21a23c71-ae83-45f4-8894-12354931e340" returned: 0 in 0.717s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-quobyte-21a23c71-ae83-45f4-8894-12354931e340" released by "delete_volume" :: held 1.887s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:43 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Created reservations ['32748db8-602f-4784-bea7-9ec1ce5ab888', '1cdc3d10-a0c1-453c-9e68-fa90623da9a0', 'fc7ebc4e-e989-4702-9862-9b83e615880d', '5035c95d-691e-4c6a-93c6-77721410b73d'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:53:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:53:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:53:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:43 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:53:43 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:44 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.708s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:44 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:53:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Deleted volume successfully. Jun 03 14:53:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-411a92a1-df01-4a7a-86aa-651f60066ba3 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-21a23c71-ae83-45f4-8894-12354931e340-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (4126748c-f1c7-46a1-8947-0e5f3474f38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8143e14e-abf4-4ca7-910e-4227abe7b16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8143e14e-abf4-4ca7-910e-4227abe7b16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2070642789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14e4d09-e7a5-4e2e-aca9-cefac4437432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:53:52Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954c06ab-0135-4a54-9e78-f195d4c6f874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954c06ab-0135-4a54-9e78-f195d4c6f874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407faf0d-989e-46f8-9483-6b168afb74a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407faf0d-989e-46f8-9483-6b168afb74a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14e4d09-e7a5-4e2e-aca9-cefac4437432', 'volume_name': 'volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cbbc6e-e3d9-40ff-91aa-c21ed67034db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cbbc6e-e3d9-40ff-91aa-c21ed67034db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c3fd37-7cd9-471c-a525-b8f49521120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:52 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Volume a14e4d09-e7a5-4e2e-aca9-cefac4437432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432', 'volume_size': 1} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2070642789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14e4d09-e7a5-4e2e-aca9-cefac4437432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:53:52Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Creating volume a14e4d09-e7a5-4e2e-aca9-cefac4437432 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:53:52 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:53:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:52 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432 1073741824 Jun 03 14:53:52 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:53 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432 1073741824" returned: 0 in 0.793s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:53 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432 Jun 03 14:53:53 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:53 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:53:53 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:53 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432" returned: 0 in 0.667s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:53:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c3fd37-7cd9-471c-a525-b8f49521120a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7ce076-4287-4ae3-bca0-99f0df2cc9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:54 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Volume volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432 (a14e4d09-e7a5-4e2e-aca9-cefac4437432): created successfully Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7ce076-4287-4ae3-bca0-99f0df2cc9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (4126748c-f1c7-46a1-8947-0e5f3474f38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:53:54 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f925c95d-9a42-4b93-8099-5c5e4753c5a5 tempest-VolumesActionsTest-1845685600 None] Created volume successfully. Jun 03 14:53:54 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.673s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "cinder-a14e4d09-e7a5-4e2e-aca9-cefac4437432-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-a14e4d09-e7a5-4e2e-aca9-cefac4437432-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "cinder-quobyte-a14e4d09-e7a5-4e2e-aca9-cefac4437432" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-quobyte-a14e4d09-e7a5-4e2e-aca9-cefac4437432" acquired by "delete_volume" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a597c056-5e69-4237-a21b-9142524e87eb]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:53:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:55 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432 Jun 03 14:53:55 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:55 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432" returned: 0 in 0.837s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:55 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432 Jun 03 14:53:55 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:56 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a14e4d09-e7a5-4e2e-aca9-cefac4437432" returned: 0 in 0.686s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-quobyte-a14e4d09-e7a5-4e2e-aca9-cefac4437432" released by "delete_volume" :: held 1.639s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:56 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Created reservations ['6f835545-10e3-4d8f-8dbb-2a7802e89e34', '0f7cd7c8-b7f7-4d87-8928-f822ea57bec4', '503da510-5160-4786-b7a0-d18c644e9977', '97d8518c-84ff-4639-bb13-314ce1998a0b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:53:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:53:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:53:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:56 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:53:56 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:57 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.685s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:53:57 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Deleted volume successfully. Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0327b9d3-d592-491a-8027-29140b5d5910 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-a14e4d09-e7a5-4e2e-aca9-cefac4437432-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (bcc3099d-a88e-4698-beed-b23eb7b513f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d940208d-44bb-45bf-b22a-79cc9e7fbd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d940208d-44bb-45bf-b22a-79cc9e7fbd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1132248023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b51cf0-f2b9-421f-a80e-72bfa49d8291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:53:58Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd362969-b62a-4214-8963-531eb35115f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd362969-b62a-4214-8963-531eb35115f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc31af0-5a89-4c9d-9c34-c2ac9896be33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc31af0-5a89-4c9d-9c34-c2ac9896be33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b51cf0-f2b9-421f-a80e-72bfa49d8291', 'volume_name': 'volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033af2be-9d62-4e8d-a535-8f538d832718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033af2be-9d62-4e8d-a535-8f538d832718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104df8d6-8f80-499b-a76a-e9bc3ffa0362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:57 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Volume d1b51cf0-f2b9-421f-a80e-72bfa49d8291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291', 'volume_size': 1} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1132248023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b51cf0-f2b9-421f-a80e-72bfa49d8291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:53:58Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Creating volume d1b51cf0-f2b9-421f-a80e-72bfa49d8291 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:53:57 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:53:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:57 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291 1073741824 Jun 03 14:53:57 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:58 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291 1073741824" returned: 0 in 0.847s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:53:58 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291 Jun 03 14:53:58 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:53:59 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jun 03 14:53:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291" returned: 0 in 0.685s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:53:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:53:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:53:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104df8d6-8f80-499b-a76a-e9bc3ffa0362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7fe4ac-f0fa-4a1c-abfb-d6ce17a77d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:53:59 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Volume volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291 (d1b51cf0-f2b9-421f-a80e-72bfa49d8291): created successfully Jun 03 14:53:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7fe4ac-f0fa-4a1c-abfb-d6ce17a77d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:53:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (bcc3099d-a88e-4698-beed-b23eb7b513f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:53:59 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-73542592-cd59-4d1b-bd63-6e1b96d2daf5 tempest-VolumesActionsTest-1845685600 None] Created volume successfully. Jun 03 14:54:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "cinder-d1b51cf0-f2b9-421f-a80e-72bfa49d8291-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-d1b51cf0-f2b9-421f-a80e-72bfa49d8291-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "cinder-quobyte-d1b51cf0-f2b9-421f-a80e-72bfa49d8291" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-quobyte-d1b51cf0-f2b9-421f-a80e-72bfa49d8291" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:00 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ad76dd-0186-4e4e-b09f-3f5e3d53b8d4]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:00 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291 Jun 03 14:54:00 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:00 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291" returned: 0 in 0.852s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:01 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291 Jun 03 14:54:01 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:01 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d1b51cf0-f2b9-421f-a80e-72bfa49d8291" returned: 0 in 0.870s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-quobyte-d1b51cf0-f2b9-421f-a80e-72bfa49d8291" released by "delete_volume" :: held 1.775s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:01 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Created reservations ['b64066e3-9351-4a33-994c-a63196c1e381', '3bcbba3a-9973-4d6b-96d4-5dda6b327009', 'a5f70956-cafb-44b1-8441-2cf5477cb277', 'af6bb4f7-df2d-4ee6-a0f7-b8cfe69b4a1e'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:54:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:02 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:54:02 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (f55a7e42-0e49-4e1e-98bb-f18759477561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6260234-246a-47e6-af51-a9dcc26ba175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6260234-246a-47e6-af51-a9dcc26ba175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1674733409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8828f3f-c221-49b5-b467-278cf5bac46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:03Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbaa16e-acbc-44e1-bf38-289d3b846d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbaa16e-acbc-44e1-bf38-289d3b846d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8f0e1c-dd93-4f0d-9a20-da82552aa620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8f0e1c-dd93-4f0d-9a20-da82552aa620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8828f3f-c221-49b5-b467-278cf5bac46a', 'volume_name': 'volume-a8828f3f-c221-49b5-b467-278cf5bac46a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f077a1d2-af24-429f-8236-b53cd447f082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f077a1d2-af24-429f-8236-b53cd447f082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f87c3f9-6dbc-425e-a888-1a8981df1c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:03 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:03 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Volume a8828f3f-c221-49b5-b467-278cf5bac46a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8828f3f-c221-49b5-b467-278cf5bac46a', 'volume_size': 1} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1674733409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8828f3f-c221-49b5-b467-278cf5bac46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:03Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Creating volume a8828f3f-c221-49b5-b467-278cf5bac46a {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:54:03 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.052s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:54:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Deleted volume successfully. Jun 03 14:54:03 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a 1073741824 Jun 03 14:54:03 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:03 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-73fa36e3-880f-4d0d-bf10-43c602419dc0 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-d1b51cf0-f2b9-421f-a80e-72bfa49d8291-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:04 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a 1073741824" returned: 0 in 1.125s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:04 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a Jun 03 14:54:04 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Flow 'volume_create_manager' (858bd043-ffd3-4a2c-8229-7e6f1119b242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436b22e7-e0a0-4e8d-b0b3-896d9510553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436b22e7-e0a0-4e8d-b0b3-896d9510553c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-207866637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3256d379-51b8-4a30-b2b3-85f61c1f8108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6cf28084f4953a0dd63c09db97167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:05Z,use_quota=True,user_id='4d4ccf31a61f42f1a9c77e1babc1d808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b014ae5-683f-47bf-a497-8cb550dedc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b014ae5-683f-47bf-a497-8cb550dedc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630db6db-1658-4e19-be93-34e4d3be9b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630db6db-1658-4e19-be93-34e4d3be9b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3256d379-51b8-4a30-b2b3-85f61c1f8108', 'volume_name': 'volume-3256d379-51b8-4a30-b2b3-85f61c1f8108', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4118c025-bd3a-4596-8934-2993695bbc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4118c025-bd3a-4596-8934-2993695bbc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbc9d48-0962-48a2-a1a6-34d5747dc7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:04 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Volume 3256d379-51b8-4a30-b2b3-85f61c1f8108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3256d379-51b8-4a30-b2b3-85f61c1f8108', 'volume_size': 1} Jun 03 14:54:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:05 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a" returned: 0 in 0.840s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-207866637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3256d379-51b8-4a30-b2b3-85f61c1f8108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6cf28084f4953a0dd63c09db97167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:05Z,use_quota=True,user_id='4d4ccf31a61f42f1a9c77e1babc1d808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Creating volume 3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:54:05 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f87c3f9-6dbc-425e-a888-1a8981df1c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8828f3f-c221-49b5-b467-278cf5bac46a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81962709-f7b8-4e66-8b1d-2300eaa72253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:05 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 1073741824 Jun 03 14:54:05 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:05 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Volume volume-a8828f3f-c221-49b5-b467-278cf5bac46a (a8828f3f-c221-49b5-b467-278cf5bac46a): created successfully Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81962709-f7b8-4e66-8b1d-2300eaa72253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (f55a7e42-0e49-4e1e-98bb-f18759477561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:05 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-2918c897-e5d4-4b4a-a59d-0665cf5c255f tempest-VolumesActionsTest-1845685600 None] Created volume successfully. Jun 03 14:54:06 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 1073741824" returned: 0 in 1.199s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:06 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 Jun 03 14:54:06 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "cinder-a8828f3f-c221-49b5-b467-278cf5bac46a-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-a8828f3f-c221-49b5-b467-278cf5bac46a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "cinder-quobyte-a8828f3f-c221-49b5-b467-278cf5bac46a" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-quobyte-a8828f3f-c221-49b5-b467-278cf5bac46a" acquired by "delete_volume" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:06 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[17caf6d5-64e0-4f15-9c96-1de5c9527ccd]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:06 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a Jun 03 14:54:06 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:07 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108" returned: 0 in 0.978s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] <== create_volume: return (2243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:54:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbc9d48-0962-48a2-a1a6-34d5747dc7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3256d379-51b8-4a30-b2b3-85f61c1f8108', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdacc0f-d75f-4bde-90fe-9eb6fed7a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:07 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Volume volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 (3256d379-51b8-4a30-b2b3-85f61c1f8108): created successfully Jun 03 14:54:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdacc0f-d75f-4bde-90fe-9eb6fed7a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Flow 'volume_create_manager' (858bd043-ffd3-4a2c-8229-7e6f1119b242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:07 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-43d4eaff-8662-411e-8957-26832fd1019c tempest-TestStampPattern-93979479 None] Created volume successfully. Jun 03 14:54:07 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a" returned: 0 in 0.951s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:07 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a Jun 03 14:54:07 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:08 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a8828f3f-c221-49b5-b467-278cf5bac46a" returned: 0 in 0.676s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-quobyte-a8828f3f-c221-49b5-b467-278cf5bac46a" released by "delete_volume" :: held 1.694s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:08 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Created reservations ['cdbb6096-9708-4f3b-a1c9-b781311a2888', 'ea4f5730-01aa-4d02-8dfb-e176b3d05f09', 'c03d4a64-3fe2-44e9-8256-5f4bac2dedb6', '875dfa94-ee83-4305-8e1c-53960d21bbc5'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:54:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:08 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:54:08 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:09 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.670s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:54:09 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Deleted volume successfully. Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5633725b-1d58-4f8d-8058-1fbe4aa40398 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-a8828f3f-c221-49b5-b467-278cf5bac46a-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (48a07676-9589-4dc5-9e31-69ba9de0199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebb1ad5-11f9-4771-acb6-c2c1913239fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebb1ad5-11f9-4771-acb6-c2c1913239fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-210280851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbdd98d-af00-43fe-bab6-2eb2ae97b29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:09Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e404f0bb-291b-4119-8325-d946a1a70fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e404f0bb-291b-4119-8325-d946a1a70fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f0afc1-59cd-4f0d-be03-1ca54b5a8fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f0afc1-59cd-4f0d-be03-1ca54b5a8fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbdd98d-af00-43fe-bab6-2eb2ae97b29c', 'volume_name': 'volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce055ab-db01-496e-98e3-785d512e6b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce055ab-db01-496e-98e3-785d512e6b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e76416f-07fa-4090-aa98-2bee505e43af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:09 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Volume 3bbdd98d-af00-43fe-bab6-2eb2ae97b29c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c', 'volume_size': 1} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-210280851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbdd98d-af00-43fe-bab6-2eb2ae97b29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:09Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Creating volume 3bbdd98d-af00-43fe-bab6-2eb2ae97b29c {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:54:09 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:54:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:09 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c 1073741824 Jun 03 14:54:09 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:10 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c 1073741824" returned: 0 in 0.817s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:10 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c Jun 03 14:54:10 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:10 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c" returned: 0 in 0.623s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:54:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e76416f-07fa-4090-aa98-2bee505e43af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a4e9fb-c45e-483c-af2e-54bc15d8943b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:10 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Volume volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c (3bbdd98d-af00-43fe-bab6-2eb2ae97b29c): created successfully Jun 03 14:54:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a4e9fb-c45e-483c-af2e-54bc15d8943b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (48a07676-9589-4dc5-9e31-69ba9de0199e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:10 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d87b2f5b-55ff-415f-aa13-0aaffd9bd450 tempest-VolumesActionsTest-1845685600 None] Created volume successfully. Jun 03 14:54:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "cinder-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "cinder-quobyte-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-quobyte-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:11 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed5b483-b941-4c2f-b4fc-49a242b91d57]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:11 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c Jun 03 14:54:11 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:12 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c" returned: 0 in 0.844s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:12 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c Jun 03 14:54:12 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:13 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c" returned: 0 in 0.673s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-quobyte-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c" released by "delete_volume" :: held 1.582s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:13 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=51,cinder:UPDATE=81,cinder:INSERT=25,cinder:DELETE=11 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:54:13 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Created reservations ['b74a2741-6e85-40cf-892d-5c347b7c82f0', '934ed2df-86fe-4cb4-860a-f8093d823987', 'd1db6913-78f8-4559-b6b0-3049ccb97792', 'faadf56d-3e56-4c66-81f5-5140f775d354'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:54:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:13 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:54:13 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:14 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.615s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:54:14 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Deleted volume successfully. Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7bca96ed-62eb-4299-a656-a83987a87602 tempest-VolumesActionsTest-1932174973 None] Lock "cinder-3bbdd98d-af00-43fe-bab6-2eb2ae97b29c-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (4419d493-8d1e-48fa-9404-1d74e0f845cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215c15a0-41e2-4112-b2e4-89bcaa70b95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215c15a0-41e2-4112-b2e4-89bcaa70b95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623991020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a7258d-0448-4012-a6d7-ce7d656f7191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:14Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081cb713-3cdb-442d-8fda-04ff83ddcaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081cb713-3cdb-442d-8fda-04ff83ddcaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ead249-f93e-4921-b9f3-a8395c9840fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ead249-f93e-4921-b9f3-a8395c9840fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a7258d-0448-4012-a6d7-ce7d656f7191', 'volume_name': 'volume-27a7258d-0448-4012-a6d7-ce7d656f7191', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eae7be9-324f-477c-a8ec-eb5ee3697ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eae7be9-324f-477c-a8ec-eb5ee3697ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936af09d-a72c-45de-8651-20cff11d3ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:14 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Volume 27a7258d-0448-4012-a6d7-ce7d656f7191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a7258d-0448-4012-a6d7-ce7d656f7191', 'volume_size': 1} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623991020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a7258d-0448-4012-a6d7-ce7d656f7191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2928ea511e4b40ab8b063d6ba51628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:14Z,use_quota=True,user_id='d2e23cef54a9466d9fc0be6e39ad2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Creating volume 27a7258d-0448-4012-a6d7-ce7d656f7191 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:54:14 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:54:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:14 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191 1073741824 Jun 03 14:54:14 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:15 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191 1073741824" returned: 0 in 0.829s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:15 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191 Jun 03 14:54:15 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:16 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191" returned: 0 in 0.595s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:54:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936af09d-a72c-45de-8651-20cff11d3ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a7258d-0448-4012-a6d7-ce7d656f7191', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a61a96-472a-4266-88d9-d7d8b669af93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:16 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Volume volume-27a7258d-0448-4012-a6d7-ce7d656f7191 (27a7258d-0448-4012-a6d7-ce7d656f7191): created successfully Jun 03 14:54:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a61a96-472a-4266-88d9-d7d8b669af93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Flow 'volume_create_manager' (4419d493-8d1e-48fa-9404-1d74e0f845cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:16 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-0b460d67-008f-4626-8a61-4dac3ccd4bd7 tempest-VolumesActionsTest-1845685600 None] Created volume successfully. Jun 03 14:54:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "cinder-27a7258d-0448-4012-a6d7-ce7d656f7191-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-27a7258d-0448-4012-a6d7-ce7d656f7191-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "cinder-quobyte-27a7258d-0448-4012-a6d7-ce7d656f7191" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-quobyte-27a7258d-0448-4012-a6d7-ce7d656f7191" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:17 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc46caf0-df5b-4c07-ae12-07117a2d812d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:17 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191 Jun 03 14:54:17 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:18 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191" returned: 0 in 1.040s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:18 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191 Jun 03 14:54:18 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:18 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-27a7258d-0448-4012-a6d7-ce7d656f7191" returned: 0 in 0.621s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-quobyte-27a7258d-0448-4012-a6d7-ce7d656f7191" released by "delete_volume" :: held 1.706s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:19 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Created reservations ['5e4ec089-e768-425f-8363-9a0571f06b5c', '48190f72-4911-4b27-b00f-80e7208c4b30', '14b4822e-e1e6-4dd4-a7a9-f0d1ceae1e35', 'b99d881c-0db3-4cb2-9277-70311603b9f5'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:54:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:19 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:54:19 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:19 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.738s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:19 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:54:19 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Deleted volume successfully. Jun 03 14:54:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9fd87b8-25d6-4361-b9d6-d5d6f1d2f541 tempest-VolumesActionsTest-1845685600 None] Lock "cinder-27a7258d-0448-4012-a6d7-ce7d656f7191-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Flow 'volume_create_manager' (c88e6494-c030-45dc-9920-4acbf0bd4c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830e7eeb-c20c-46f1-a6f2-d302960d7d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830e7eeb-c20c-46f1-a6f2-d302960d7d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-576600785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052c3ed5-2a1a-4943-977e-c10f6f38c09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd2f55f11e3441f9dbaed8e85574551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:28Z,use_quota=True,user_id='f75e806710384c57bb662d49524b00fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d154898-0290-487d-90e5-c77994362922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d154898-0290-487d-90e5-c77994362922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502dbf2b-a543-4c6e-8e1b-f3f1f83eae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502dbf2b-a543-4c6e-8e1b-f3f1f83eae80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052c3ed5-2a1a-4943-977e-c10f6f38c09a', 'volume_name': 'volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b849404-2150-433f-a1b6-7b22d79087a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b849404-2150-433f-a1b6-7b22d79087a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff32f56f-e155-4a49-bdb8-19ac6dbc07a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:27 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Volume 052c3ed5-2a1a-4943-977e-c10f6f38c09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a', 'volume_size': 1} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-576600785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052c3ed5-2a1a-4943-977e-c10f6f38c09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd2f55f11e3441f9dbaed8e85574551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:28Z,use_quota=True,user_id='f75e806710384c57bb662d49524b00fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Creating volume 052c3ed5-2a1a-4943-977e-c10f6f38c09a {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:54:27 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:54:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:27 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a 1073741824 Jun 03 14:54:27 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:28 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a 1073741824" returned: 0 in 0.908s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:28 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a Jun 03 14:54:28 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:29 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a" returned: 0 in 0.648s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:54:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff32f56f-e155-4a49-bdb8-19ac6dbc07a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa9d8d8-ef82-4673-b9ad-77a8b7f8b005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:29 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Volume volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a (052c3ed5-2a1a-4943-977e-c10f6f38c09a): created successfully Jun 03 14:54:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa9d8d8-ef82-4673-b9ad-77a8b7f8b005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Flow 'volume_create_manager' (c88e6494-c030-45dc-9920-4acbf0bd4c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:29 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c1e95042-6f19-444b-87ba-67e98c05b082 tempest-AttachVolumeTestJSON-747404581 None] Created volume successfully. Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Flow 'volume_create_manager' (bf20cf8a-c492-4033-8421-4f69588074f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24830019-68c3-4295-a682-2a3001b475c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24830019-68c3-4295-a682-2a3001b475c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1000491280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8188d1f-1499-4dbc-a57b-2479b1f44f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c80653fa6f43d58779c1d00cbc901c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:32Z,use_quota=True,user_id='75f9d040f4264de4afe5f766c323f976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1420e63d-2997-46c0-9311-89240ce7d7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1420e63d-2997-46c0-9311-89240ce7d7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1187b835-2e4d-4704-b6c4-8304120e4021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1187b835-2e4d-4704-b6c4-8304120e4021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8188d1f-1499-4dbc-a57b-2479b1f44f08', 'volume_name': 'volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5c7a90-bea0-4cf5-a173-9b5ba274103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5c7a90-bea0-4cf5-a173-9b5ba274103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ebbe90-5795-4919-b4c4-6b5110958462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:32 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Volume c8188d1f-1499-4dbc-a57b-2479b1f44f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08', 'volume_size': 1} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1000491280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8188d1f-1499-4dbc-a57b-2479b1f44f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c80653fa6f43d58779c1d00cbc901c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:32Z,use_quota=True,user_id='75f9d040f4264de4afe5f766c323f976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Creating volume c8188d1f-1499-4dbc-a57b-2479b1f44f08 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:54:32 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:32 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08 1073741824 Jun 03 14:54:32 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-fd10be62-cf83-4aa9-8301-1b02dcd383ea req-bb60ba8d-a3cf-4805-a0e4-75ec574380dd tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:33 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08 1073741824" returned: 0 in 0.759s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:33 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08 Jun 03 14:54:33 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:33 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08" returned: 0 in 0.580s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-fd10be62-cf83-4aa9-8301-1b02dcd383ea req-bb60ba8d-a3cf-4805-a0e4-75ec574380dd tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.964s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ebbe90-5795-4919-b4c4-6b5110958462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e8bc1d-cf3a-44af-8f84-116711605636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[250607ec-4205-48e9-a45b-534e5c6e7e28]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-fd10be62-cf83-4aa9-8301-1b02dcd383ea req-bb60ba8d-a3cf-4805-a0e4-75ec574380dd tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:33 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Volume volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08 (c8188d1f-1499-4dbc-a57b-2479b1f44f08): created successfully Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e8bc1d-cf3a-44af-8f84-116711605636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Flow 'volume_create_manager' (bf20cf8a-c492-4033-8421-4f69588074f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:33 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-660dc47d-1888-4d25-a144-6cda1a074829 tempest-VolumesTransfersTest-936778111 None] Created volume successfully. Jun 03 14:54:34 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a Jun 03 14:54:34 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:34 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-fd10be62-cf83-4aa9-8301-1b02dcd383ea req-bb60ba8d-a3cf-4805-a0e4-75ec574380dd tempest-AttachVolumeTestJSON-747404581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a" returned: 0 in 0.686s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-fd10be62-cf83-4aa9-8301-1b02dcd383ea req-bb60ba8d-a3cf-4805-a0e4-75ec574380dd tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.716s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-fd10be62-cf83-4aa9-8301-1b02dcd383ea req-bb60ba8d-a3cf-4805-a0e4-75ec574380dd tempest-AttachVolumeTestJSON-747404581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cb71d04-5078-4630-a021-739e8e9736d4', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:54:34 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-fd10be62-cf83-4aa9-8301-1b02dcd383ea req-bb60ba8d-a3cf-4805-a0e4-75ec574380dd tempest-AttachVolumeTestJSON-747404581 None] attachment_update completed successfully. Jun 03 14:54:35 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-895d6d4e-5c03-4839-90db-ae7b48eea50a tempest-VolumesTransfersTest-554023270 None] Transfer volume completed successfully. Jun 03 14:54:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Acquiring lock "cinder-c8188d1f-1499-4dbc-a57b-2479b1f44f08-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Lock "cinder-c8188d1f-1499-4dbc-a57b-2479b1f44f08-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:36 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=63,cinder:UPDATE=85,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:54:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Acquiring lock "cinder-quobyte-c8188d1f-1499-4dbc-a57b-2479b1f44f08" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Lock "cinder-quobyte-c8188d1f-1499-4dbc-a57b-2479b1f44f08" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e72786d-0976-4dc5-b52a-33ed0f33db23]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:36 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08 Jun 03 14:54:36 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:36 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08" returned: 0 in 0.706s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:36 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08 Jun 03 14:54:36 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:37 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c8188d1f-1499-4dbc-a57b-2479b1f44f08" returned: 0 in 0.576s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Lock "cinder-quobyte-c8188d1f-1499-4dbc-a57b-2479b1f44f08" released by "delete_volume" :: held 1.329s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:37 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Created reservations ['51f19055-cfac-46a2-8cdf-472a6ba21db1', 'e3719be3-1c2a-4d3a-965b-59405e990136', '6bb461ed-b3ea-4628-804d-c45daa661cf2', '601dfcaa-9ccf-4948-975d-6eb90a683335'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:54:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:37 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:54:37 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:38 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.611s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:54:38 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Deleted volume successfully. Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b785e170-148d-4246-8b25-94e70b3044ba tempest-VolumesTransfersTest-1041806518 None] Lock "cinder-c8188d1f-1499-4dbc-a57b-2479b1f44f08-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Flow 'volume_create_manager' (945a7fcf-dfd4-4f9c-bf7f-84414db02514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ececf50-1418-42c9-a2e0-d9eca397b7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ececf50-1418-42c9-a2e0-d9eca397b7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-680344539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c522ec17-77ec-4b7c-8769-44d901344049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c80653fa6f43d58779c1d00cbc901c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:39Z,use_quota=True,user_id='75f9d040f4264de4afe5f766c323f976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97a7a0e-c7a4-4aea-87ec-3a92099ccea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97a7a0e-c7a4-4aea-87ec-3a92099ccea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f75937e-2fad-4ade-8bed-ea8116f2052c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f75937e-2fad-4ade-8bed-ea8116f2052c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c522ec17-77ec-4b7c-8769-44d901344049', 'volume_name': 'volume-c522ec17-77ec-4b7c-8769-44d901344049', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ffa925-f4ed-4554-8264-6fa976ab4297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ffa925-f4ed-4554-8264-6fa976ab4297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f99d384-42d6-4963-9fec-922a093fbc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:38 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Volume c522ec17-77ec-4b7c-8769-44d901344049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c522ec17-77ec-4b7c-8769-44d901344049', 'volume_size': 1} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-680344539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c522ec17-77ec-4b7c-8769-44d901344049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c80653fa6f43d58779c1d00cbc901c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:39Z,use_quota=True,user_id='75f9d040f4264de4afe5f766c323f976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Creating volume c522ec17-77ec-4b7c-8769-44d901344049 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:54:38 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:54:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:38 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049 1073741824 Jun 03 14:54:38 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:39 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049 1073741824" returned: 0 in 0.808s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:39 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049 Jun 03 14:54:39 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:40 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049" returned: 0 in 0.588s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:40 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:54:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f99d384-42d6-4963-9fec-922a093fbc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c522ec17-77ec-4b7c-8769-44d901344049', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab5ca93-72bb-40bc-b471-5c3a32188417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:40 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Volume volume-c522ec17-77ec-4b7c-8769-44d901344049 (c522ec17-77ec-4b7c-8769-44d901344049): created successfully Jun 03 14:54:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab5ca93-72bb-40bc-b471-5c3a32188417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:40 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Flow 'volume_create_manager' (945a7fcf-dfd4-4f9c-bf7f-84414db02514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:40 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-3b1e6f08-8050-4dbd-9d00-7e8cad695c17 tempest-VolumesTransfersTest-936778111 None] Created volume successfully. Jun 03 14:54:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Acquiring lock "cinder-c522ec17-77ec-4b7c-8769-44d901344049-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Lock "cinder-c522ec17-77ec-4b7c-8769-44d901344049-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Acquiring lock "cinder-quobyte-c522ec17-77ec-4b7c-8769-44d901344049" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Lock "cinder-quobyte-c522ec17-77ec-4b7c-8769-44d901344049" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:41 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b003f44-c451-411c-8879-d401aa56acf6]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:41 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049 Jun 03 14:54:41 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:42 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049" returned: 0 in 0.736s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:42 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049 Jun 03 14:54:42 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:42 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c522ec17-77ec-4b7c-8769-44d901344049" returned: 0 in 0.601s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Lock "cinder-quobyte-c522ec17-77ec-4b7c-8769-44d901344049" released by "delete_volume" :: held 1.383s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Created reservations ['b631bddc-3cd4-4737-a085-23e4c4d1e480', 'c00eb32d-0ac8-4e7a-bc85-631b795c5dd6', 'd0fd441c-3c4c-4573-86f6-13feab9af856', 'a0317d61-ed42-4da2-917e-7c0bef116586'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:42 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:54:42 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:43 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.627s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:43 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:54:43 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Deleted volume successfully. Jun 03 14:54:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2768cecd-1448-4caf-a093-755022b086ca tempest-VolumesTransfersTest-1041806518 None] Lock "cinder-c522ec17-77ec-4b7c-8769-44d901344049-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-a3dee57b-7124-4cc8-98bd-acd47a8ee633 req-725b27bb-e13a-44c5-9c3f-37f2919867a5 tempest-TestStampPattern-93979479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-a3dee57b-7124-4cc8-98bd-acd47a8ee633 req-725b27bb-e13a-44c5-9c3f-37f2919867a5 tempest-TestStampPattern-93979479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:46 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a9910b-6a42-47af-81e5-ee7e92e32d06]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-a3dee57b-7124-4cc8-98bd-acd47a8ee633 req-725b27bb-e13a-44c5-9c3f-37f2919867a5 tempest-TestStampPattern-93979479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:47 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 Jun 03 14:54:47 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:47 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-a3dee57b-7124-4cc8-98bd-acd47a8ee633 req-725b27bb-e13a-44c5-9c3f-37f2919867a5 tempest-TestStampPattern-93979479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108" returned: 0 in 0.815s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-a3dee57b-7124-4cc8-98bd-acd47a8ee633 req-725b27bb-e13a-44c5-9c3f-37f2919867a5 tempest-TestStampPattern-93979479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.845s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-a3dee57b-7124-4cc8-98bd-acd47a8ee633 req-725b27bb-e13a-44c5-9c3f-37f2919867a5 tempest-TestStampPattern-93979479 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-3256d379-51b8-4a30-b2b3-85f61c1f8108', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '525ed578-0154-4928-9df2-1174061b9826', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:54:47 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-a3dee57b-7124-4cc8-98bd-acd47a8ee633 req-725b27bb-e13a-44c5-9c3f-37f2919867a5 tempest-TestStampPattern-93979479 None] attachment_update completed successfully. Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (55ad05b7-4e93-4078-9971-4f3a65b4f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986132b2-b9f0-4cda-ba04-63463844081d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986132b2-b9f0-4cda-ba04-63463844081d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1026263246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d744fa-312b-40b6-a935-654767493a3d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:49Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880fbf0b-0686-4323-a1b0-b5f919e64388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880fbf0b-0686-4323-a1b0-b5f919e64388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276406b8-1aec-4c39-9a2b-13e4dd1bbc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276406b8-1aec-4c39-9a2b-13e4dd1bbc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d744fa-312b-40b6-a935-654767493a3d', 'volume_name': 'volume-21d744fa-312b-40b6-a935-654767493a3d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5a7c4d-c670-4ad9-b5e5-e3ea230b9326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5a7c4d-c670-4ad9-b5e5-e3ea230b9326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b0d67a-cf78-47e5-89d4-7ab04df024df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:48 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Volume 21d744fa-312b-40b6-a935-654767493a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d744fa-312b-40b6-a935-654767493a3d', 'volume_size': 1} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1026263246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d744fa-312b-40b6-a935-654767493a3d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:49Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Creating volume 21d744fa-312b-40b6-a935-654767493a3d {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:54:48 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:54:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:48 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d 1073741824 Jun 03 14:54:48 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:49 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d 1073741824" returned: 0 in 0.760s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:49 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d Jun 03 14:54:49 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:50 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d" returned: 0 in 0.615s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:54:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b0d67a-cf78-47e5-89d4-7ab04df024df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d744fa-312b-40b6-a935-654767493a3d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d40a79-a987-42ff-826e-792c628ae5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:50 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Volume volume-21d744fa-312b-40b6-a935-654767493a3d (21d744fa-312b-40b6-a935-654767493a3d): created successfully Jun 03 14:54:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d40a79-a987-42ff-826e-792c628ae5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (55ad05b7-4e93-4078-9971-4f3a65b4f9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:50 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-6346d409-d752-46ad-9f43-4a1646681c6f tempest-VolumesGetTest-573055508 None] Created volume successfully. Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (92155c3c-263d-4d21-b5ab-207ee44e0a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ea96e5-58b8-4c0d-96d2-de7c9bf21564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ea96e5-58b8-4c0d-96d2-de7c9bf21564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1017865805',display_name='tempest-VolumesGetTest-Volume-507332619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaf660e-c4cc-4c17-b35c-636d146c1273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:52Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8966d038-2027-4da1-812e-bf9440daca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8966d038-2027-4da1-812e-bf9440daca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f311aa-98bd-4af9-843c-da38078ce778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f311aa-98bd-4af9-843c-da38078ce778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beaf660e-c4cc-4c17-b35c-636d146c1273', 'volume_name': 'volume-beaf660e-c4cc-4c17-b35c-636d146c1273', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bef28c1-352e-44d5-bbf2-cb8b500a5cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bef28c1-352e-44d5-bbf2-cb8b500a5cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a667f000-2ae1-4fb3-aabe-d6f24062ce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:51 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Volume beaf660e-c4cc-4c17-b35c-636d146c1273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beaf660e-c4cc-4c17-b35c-636d146c1273', 'volume_size': 1} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1017865805',display_name='tempest-VolumesGetTest-Volume-507332619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaf660e-c4cc-4c17-b35c-636d146c1273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:52Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Creating volume beaf660e-c4cc-4c17-b35c-636d146c1273 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:54:51 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:54:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:52 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273 1073741824 Jun 03 14:54:52 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:52 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273 1073741824" returned: 0 in 0.951s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:53 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273 Jun 03 14:54:53 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:53 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273" returned: 0 in 0.641s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a667f000-2ae1-4fb3-aabe-d6f24062ce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beaf660e-c4cc-4c17-b35c-636d146c1273', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99bf463-ebf4-43f2-bcbf-4733470adcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:53 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Volume volume-beaf660e-c4cc-4c17-b35c-636d146c1273 (beaf660e-c4cc-4c17-b35c-636d146c1273): created successfully Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99bf463-ebf4-43f2-bcbf-4733470adcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:53 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:54:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (92155c3c-263d-4d21-b5ab-207ee44e0a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:53 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:53 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a5e983d8-5290-414f-a56e-0c92ae18082f tempest-VolumesGetTest-573055508 None] Created volume successfully. Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-beaf660e-c4cc-4c17-b35c-636d146c1273-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Lock "cinder-beaf660e-c4cc-4c17-b35c-636d146c1273-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-quobyte-beaf660e-c4cc-4c17-b35c-636d146c1273" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-beaf660e-c4cc-4c17-b35c-636d146c1273" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfce5ed7-66e2-4d77-b467-1d838f3cf481]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:54 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.844s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:54:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:54:54 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273 Jun 03 14:54:54 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:55 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273" returned: 0 in 0.753s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:55 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273 Jun 03 14:54:55 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:55 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-beaf660e-c4cc-4c17-b35c-636d146c1273" returned: 0 in 0.623s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-beaf660e-c4cc-4c17-b35c-636d146c1273" released by "delete_volume" :: held 1.442s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Created reservations ['57e7c68a-bb0b-4493-b341-beef23e4a2ce', 'c676c9e4-a9fe-4670-a5ab-6ca97ba649d7', 'f9b09804-3991-473f-b3d6-d406e14dc529', 'af803f1e-80b8-4881-85be-1aed4d63e7e0'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:55 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:54:55 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:56 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.607s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:56 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:54:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Deleted volume successfully. Jun 03 14:54:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-df27476e-90c5-4e1f-b20c-a619e8931d21 tempest-VolumesGetTest-573055508 None] Lock "cinder-beaf660e-c4cc-4c17-b35c-636d146c1273-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-21d744fa-312b-40b6-a935-654767493a3d-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Lock "cinder-21d744fa-312b-40b6-a935-654767493a3d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-quobyte-21d744fa-312b-40b6-a935-654767493a3d" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:54:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-21d744fa-312b-40b6-a935-654767493a3d" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:54:56 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9c7ff9-aafe-4f95-b34a-d4a7fbae1bea]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:56 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d Jun 03 14:54:56 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:57 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-ff78afaf-bf30-4fc6-9a22-efe022d55cdf req-4ae3fb66-8674-4ac9-848c-0e1f74884581 tempest-TestStampPattern-93979479 None] Terminate volume connection completed successfully. Jun 03 14:54:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-ff78afaf-bf30-4fc6-9a22-efe022d55cdf req-4ae3fb66-8674-4ac9-848c-0e1f74884581 tempest-TestStampPattern-93979479 None] Deleting attachment 525ed578-0154-4928-9df2-1174061b9826. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:54:57 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d" returned: 0 in 0.707s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:57 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d Jun 03 14:54:57 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:58 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-21d744fa-312b-40b6-a935-654767493a3d" returned: 0 in 0.626s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-21d744fa-312b-40b6-a935-654767493a3d" released by "delete_volume" :: held 1.390s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Created reservations ['8c84de72-2618-4932-a8da-b7890b22e8f3', 'd4394953-a8ae-45e2-a049-791d01bc36dc', '162668bd-53e0-4240-a938-f768ff3bc16a', '9e19c07c-b51a-4393-b0f5-10a2d48ef60d'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:58 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:54:58 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:58 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.586s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:54:58 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Deleted volume successfully. Jun 03 14:54:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f67e098b-f86d-4c2f-9f1f-b19ce562f3bc tempest-VolumesGetTest-573055508 None] Lock "cinder-21d744fa-312b-40b6-a935-654767493a3d-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Creating offline snapshot f288a0df-c8bd-4fa2-8095-69a4498169a3 of volume 3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df114b3-e703-49b8-8a9e-bc263004cd2a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:54:59 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 Jun 03 14:54:59 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (6b9f58ba-aa71-4a54-ab6a-14d9dfa26104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68449e7-c14e-4e12-a88a-86ea3487509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68449e7-c14e-4e12-a88a-86ea3487509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1493379882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165bddd2-60aa-4801-949e-12ced68570a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:59Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdfba7a-385f-4bb2-b91e-ebc09888fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdfba7a-385f-4bb2-b91e-ebc09888fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04aa3dd-d36b-4941-8a61-8c550cc624a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04aa3dd-d36b-4941-8a61-8c550cc624a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165bddd2-60aa-4801-949e-12ced68570a4', 'volume_name': 'volume-165bddd2-60aa-4801-949e-12ced68570a4', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db82c03-e867-4ae7-b49d-3f59cd1c920d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db82c03-e867-4ae7-b49d-3f59cd1c920d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17346a12-8eea-4e71-9bbd-69357c3e4507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:54:59 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Volume 165bddd2-60aa-4801-949e-12ced68570a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165bddd2-60aa-4801-949e-12ced68570a4', 'volume_size': 1} Jun 03 14:54:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:00 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108" returned: 0 in 0.705s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:00 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 1G Jun 03 14:55:00 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:00 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 1G" returned: 0 in 0.844s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:00 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 Jun 03 14:55:00 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:01 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3" returned: 0 in 0.627s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:01 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 is being set with open permissions: ugo+rw Jun 03 14:55:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:01 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 Jun 03 14:55:01 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:02 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3" returned: 0 in 0.579s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:02 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.info Jun 03 14:55:02 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:02 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.info" returned: 0 in 0.601s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:02 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.info is being set with open permissions: ugo+rw Jun 03 14:55:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:02 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.info Jun 03 14:55:02 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:03 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.info" returned: 0 in 0.591s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.072s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.792s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1493379882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165bddd2-60aa-4801-949e-12ced68570a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:54:59Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Creating volume 165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:55:03 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:55:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:03 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 1073741824 Jun 03 14:55:03 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-575fb7b0-6db8-420f-92c3-3af70e65297e tempest-TestStampPattern-93979479 None] Create snapshot completed successfully Jun 03 14:55:04 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 1073741824" returned: 0 in 0.811s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:04 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 Jun 03 14:55:04 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:04 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4" returned: 0 in 0.624s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:55:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17346a12-8eea-4e71-9bbd-69357c3e4507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165bddd2-60aa-4801-949e-12ced68570a4', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535a4161-5040-46ec-81d3-02f9171ddcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:04 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Volume volume-165bddd2-60aa-4801-949e-12ced68570a4 (165bddd2-60aa-4801-949e-12ced68570a4): created successfully Jun 03 14:55:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535a4161-5040-46ec-81d3-02f9171ddcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (6b9f58ba-aa71-4a54-ab6a-14d9dfa26104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:04 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a760647d-6ef9-4bbb-9597-0fb497806d89 tempest-VolumesGetTest-573055508 None] Created volume successfully. Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (2b0419eb-caf6-41ee-835f-7588fecdb7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdf965f-2e0a-4c76-b051-51bf3a35ca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdf965f-2e0a-4c76-b051-51bf3a35ca98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-382031871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdca703-3957-4c22-8ba1-99ebb4a24598,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=165bddd2-60aa-4801-949e-12ced68570a4,status='creating',terminated_at=None,updated_at=2026-06-03T12:55:06Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ca5092-2ca4-4401-85b0-16400d66bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ca5092-2ca4-4401-85b0-16400d66bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6394c6cf-b264-45f3-82ff-42452b922fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6394c6cf-b264-45f3-82ff-42452b922fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ccdca703-3957-4c22-8ba1-99ebb4a24598', 'volume_name': 'volume-ccdca703-3957-4c22-8ba1-99ebb4a24598', 'volume_size': 1, 'source_volid': '165bddd2-60aa-4801-949e-12ced68570a4', 'source_volstatus': 'available'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afe7c0a-2ed6-44ce-89aa-af79bcba77e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afe7c0a-2ed6-44ce-89aa-af79bcba77e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc070fb6-2de1-4dd5-ad77-7c37e6eb6b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:06 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Volume ccdca703-3957-4c22-8ba1-99ebb4a24598: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ccdca703-3957-4c22-8ba1-99ebb4a24598', 'volume_size': 1, 'source_volid': '165bddd2-60aa-4801-949e-12ced68570a4', 'source_volstatus': 'available'} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:06 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Cloning volume 165bddd2-60aa-4801-949e-12ced68570a4 to volume ccdca703-3957-4c22-8ba1-99ebb4a24598 Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Creating offline snapshot cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 of volume 165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[af43f3c0-2238-4c15-9ff5-3fc61927df91]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:06 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 Jun 03 14:55:06 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:07 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4" returned: 0 in 0.691s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:07 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 1G Jun 03 14:55:07 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:07 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 1G" returned: 0 in 0.708s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165bddd2-60aa-4801-949e-12ced68570a4 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:07 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165bddd2-60aa-4801-949e-12ced68570a4 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 Jun 03 14:55:07 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:08 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165bddd2-60aa-4801-949e-12ced68570a4 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4" returned: 0 in 0.626s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:08 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 is being set with open permissions: ugo+rw Jun 03 14:55:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:08 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 Jun 03 14:55:08 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:09 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4" returned: 0 in 0.596s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:09 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.info Jun 03 14:55:09 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:09 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.info" returned: 0 in 0.620s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:09 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.info is being set with open permissions: ugo+rw Jun 03 14:55:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:09 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.info Jun 03 14:55:09 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:10 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.info" returned: 0 in 0.592s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-quobyte-ccdca703-3957-4c22-8ba1-99ebb4a24598" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-ccdca703-3957-4c22-8ba1-99ebb4a24598" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] snapshot: cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4, volume: ccdca703-3957-4c22-8ba1-99ebb4a24598, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbc84c8-1299-433c-9b4d-4a7e41cf9e79]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:10 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 Jun 03 14:55:10 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:11 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4" returned: 0 in 0.875s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-165bddd2-60aa-4801-949e-12ced68570a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:55:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 14:55:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 14:55:11 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[106d13b0-e783-4ec2-b412-858ec6abe7fb]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:11 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 Jun 03 14:55:11 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:12 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4" returned: 0 in 0.726s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:12 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 14:55:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:12 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 Jun 03 14:55:12 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=60,cinder:INSERT=19,cinder:UPDATE=73,cinder:DELETE=7 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Flow 'volume_create_manager' (4a353847-8225-4033-958d-aeea4b24dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c605c7e-5398-47b3-814c-1a6fb7cbaeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c605c7e-5398-47b3-814c-1a6fb7cbaeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-416146948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f01628c-557e-4fed-8193-cf8d78dd2ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6cf28084f4953a0dd63c09db97167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f288a0df-c8bd-4fa2-8095-69a4498169a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:55:14Z,use_quota=True,user_id='4d4ccf31a61f42f1a9c77e1babc1d808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fef767d-96ef-4d87-bb9a-f888caf7e604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fef767d-96ef-4d87-bb9a-f888caf7e604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff46984-1620-4178-a46c-7261480f5b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff46984-1620-4178-a46c-7261480f5b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f01628c-557e-4fed-8193-cf8d78dd2ba8', 'volume_name': 'volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8', 'volume_size': 1, 'snapshot_id': 'f288a0df-c8bd-4fa2-8095-69a4498169a3'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf73478-7351-4c0a-a0a4-30cb8bce1033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf73478-7351-4c0a-a0a4-30cb8bce1033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eede7559-18c5-4997-b053-a1ff6632160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:14 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Volume 5f01628c-557e-4fed-8193-cf8d78dd2ba8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8', 'volume_size': 1, 'snapshot_id': 'f288a0df-c8bd-4fa2-8095-69a4498169a3'} Jun 03 14:55:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:15 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-a4df1cf2-7794-4eb8-aef2-5c9fc5ebcc26 req-8737f15d-57b5-444e-a3a8-5885a2d35cf9 tempest-AttachVolumeTestJSON-747404581 None] Terminate volume connection completed successfully. Jun 03 14:55:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-a4df1cf2-7794-4eb8-aef2-5c9fc5ebcc26 req-8737f15d-57b5-444e-a3a8-5885a2d35cf9 tempest-AttachVolumeTestJSON-747404581 None] Deleting attachment 3cb71d04-5078-4630-a021-739e8e9736d4. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:55:18 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598" returned: 0 in 6.072s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:18 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[78929b98-1dd5-49ee-a93d-b7246b6c8db3]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:18 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 Jun 03 14:55:18 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:19 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4" returned: 0 in 1.071s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:55:19 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Converted 1024.00 MB image at 168.60 MB/s Jun 03 14:55:19 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 is being set with open permissions: ugo+rw Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:19 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 Jun 03 14:55:19 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:19 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598" returned: 0 in 0.602s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-ccdca703-3957-4c22-8ba1-99ebb4a24598" released by "_copy_volume_from_snapshot" :: held 9.449s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-quobyte-cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Deleting offline snapshot cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 of volume 165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] snapshot_file for this snap is: volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e4e046-a1b3-4a9b-b6fc-17f312eb0c7c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:19 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 Jun 03 14:55:19 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:20 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4" returned: 0 in 0.747s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-165bddd2-60aa-4801-949e-12ced68570a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:55:20 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a324b9-27af-4137-9557-f244859953a3]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:20 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 Jun 03 14:55:20 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:21 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4" returned: 0 in 0.700s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:21 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 Jun 03 14:55:21 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:22 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4" returned: 0 in 0.715s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:22 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4 Jun 03 14:55:22 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:22 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4.cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4" returned: 0 in 0.636s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-cd15d96a-7648-4e35-97a8-c8eb2b0ae6e4" released by "_delete_snapshot" :: held 2.903s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.384s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.089s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Acquiring lock "cinder-quobyte-f288a0df-c8bd-4fa2-8095-69a4498169a3-5f01628c-557e-4fed-8193-cf8d78dd2ba8" by "_create_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc070fb6-2de1-4dd5-ad77-7c37e6eb6b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccdca703-3957-4c22-8ba1-99ebb4a24598', 'volume_size': 1, 'source_volid': '165bddd2-60aa-4801-949e-12ced68570a4', 'source_volstatus': 'available'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac599cb1-4c0c-4091-a749-8baa6754ec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-f288a0df-c8bd-4fa2-8095-69a4498169a3-5f01628c-557e-4fed-8193-cf8d78dd2ba8" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Creating volume 5f01628c-557e-4fed-8193-cf8d78dd2ba8 from snapshot f288a0df-c8bd-4fa2-8095-69a4498169a3 {{(pid=86614) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Acquiring lock "cinder-quobyte-5f01628c-557e-4fed-8193-cf8d78dd2ba8" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:22 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Volume volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 (ccdca703-3957-4c22-8ba1-99ebb4a24598): created successfully Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac599cb1-4c0c-4091-a749-8baa6754ec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (2b0419eb-caf6-41ee-835f-7588fecdb7df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-5f01628c-557e-4fed-8193-cf8d78dd2ba8" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] snapshot: f288a0df-c8bd-4fa2-8095-69a4498169a3, volume: 5f01628c-557e-4fed-8193-cf8d78dd2ba8, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:22 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1730f201-89fb-47bc-8f63-bf95c3f216c3 tempest-VolumesGetTest-573055508 None] Created volume successfully. Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e1f7e4-1529-4128-b367-0e4df4b959a4]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:23 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 Jun 03 14:55:23 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:23 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3" returned: 0 in 0.818s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3256d379-51b8-4a30-b2b3-85f61c1f8108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:55:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 14:55:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 14:55:23 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fed722-3bab-4c34-9cd5-9499d863057a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:23 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 Jun 03 14:55:23 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (2d7eac4a-8df3-4c56-8e89-72a693c2505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68d21fb-6c41-4c87-a121-c354cbae1780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68d21fb-6c41-4c87-a121-c354cbae1780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:55:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1266124263',display_name='tempest-VolumesGetTest-Volume-381714402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05a91f6-99c2-4767-908c-9f4384ba8e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:55:24Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da85f066-9998-4ad0-b191-c6932e12f127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da85f066-9998-4ad0-b191-c6932e12f127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d3bac7-8a33-44c4-b008-6adfc411711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d3bac7-8a33-44c4-b008-6adfc411711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f05a91f6-99c2-4767-908c-9f4384ba8e6a', 'volume_name': 'volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775ff499-fdd3-4d9b-aff2-5c0c021bb64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775ff499-fdd3-4d9b-aff2-5c0c021bb64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c419926-cf6d-4ac0-ba4d-f3d5db25bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:24 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Volume f05a91f6-99c2-4767-908c-9f4384ba8e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a', 'volume_size': 1} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:24 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108" returned: 0 in 1.005s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 14:55:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:24 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 Jun 03 14:55:24 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:30 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8" returned: 0 in 5.739s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:30 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b272cde1-904f-401c-8899-a5b776476404]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:30 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 Jun 03 14:55:30 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:32 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108" returned: 0 in 1.620s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:55:32 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Converted 1024.00 MB image at 178.39 MB/s Jun 03 14:55:32 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 is being set with open permissions: ugo+rw Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:32 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 Jun 03 14:55:32 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:32 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8" returned: 0 in 0.667s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-5f01628c-557e-4fed-8193-cf8d78dd2ba8" released by "_copy_volume_from_snapshot" :: held 10.053s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-f288a0df-c8bd-4fa2-8095-69a4498169a3-5f01628c-557e-4fed-8193-cf8d78dd2ba8" released by "_create_volume_from_snapshot" :: held 10.112s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.150s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.293s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:55:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1266124263',display_name='tempest-VolumesGetTest-Volume-381714402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05a91f6-99c2-4767-908c-9f4384ba8e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:55:24Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Creating volume f05a91f6-99c2-4767-908c-9f4384ba8e6a {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:55:32 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:32 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a 1073741824 Jun 03 14:55:32 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eede7559-18c5-4997-b053-a1ff6632160f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8', 'volume_size': 1, 'snapshot_id': 'f288a0df-c8bd-4fa2-8095-69a4498169a3'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6a5a6e-eb07-43ed-9104-f15b15c70974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:33 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Volume volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 (5f01628c-557e-4fed-8193-cf8d78dd2ba8): created successfully Jun 03 14:55:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6a5a6e-eb07-43ed-9104-f15b15c70974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Flow 'volume_create_manager' (4a353847-8225-4033-958d-aeea4b24dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:33 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b339f361-e2d8-42cc-972f-8726c6a549ab tempest-TestStampPattern-93979479 None] Created volume successfully. Jun 03 14:55:34 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a 1073741824" returned: 0 in 1.147s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:34 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a Jun 03 14:55:34 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:34 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a" returned: 0 in 0.700s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:55:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c419926-cf6d-4ac0-ba4d-f3d5db25bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069c8c3c-3bf4-4fae-aca0-25fbd1b9ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:34 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Volume volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a (f05a91f6-99c2-4767-908c-9f4384ba8e6a): created successfully Jun 03 14:55:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069c8c3c-3bf4-4fae-aca0-25fbd1b9ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (2d7eac4a-8df3-4c56-8e89-72a693c2505f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:34 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5b1b55f2-5549-4b7a-aa50-152b85513c22 tempest-VolumesGetTest-573055508 None] Created volume successfully. Jun 03 14:55:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-f05a91f6-99c2-4767-908c-9f4384ba8e6a-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Lock "cinder-f05a91f6-99c2-4767-908c-9f4384ba8e6a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-quobyte-f05a91f6-99c2-4767-908c-9f4384ba8e6a" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-f05a91f6-99c2-4767-908c-9f4384ba8e6a" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e98077-ea25-47a4-8d59-5520637fa896]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:36 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a Jun 03 14:55:36 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:36 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a" returned: 0 in 0.981s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:37 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a Jun 03 14:55:37 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:37 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f05a91f6-99c2-4767-908c-9f4384ba8e6a" returned: 0 in 0.855s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-f05a91f6-99c2-4767-908c-9f4384ba8e6a" released by "delete_volume" :: held 1.905s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:37 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=52,cinder:INSERT=12,cinder:UPDATE=54,cinder:DELETE=9 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:55:37 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Created reservations ['b5ff4045-f258-4899-bb06-b6610bfa7e5d', '6edbe466-1f9b-4f7c-b08c-67a95cbc0ec1', 'eb167353-6c36-4198-888e-942b2d0f5022', '5528dd93-4b02-44d9-b5e8-a17f0593ddcf'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:38 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:55:38 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-ccdca703-3957-4c22-8ba1-99ebb4a24598-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Lock "cinder-ccdca703-3957-4c22-8ba1-99ebb4a24598-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-quobyte-ccdca703-3957-4c22-8ba1-99ebb4a24598" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-ccdca703-3957-4c22-8ba1-99ebb4a24598" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a00353-61a6-4b6c-bbaf-99bab0cc6ff3]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:38 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 Jun 03 14:55:38 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:39 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.042s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:39 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:55:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Deleted volume successfully. Jun 03 14:55:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20b8cbc0-40ef-4825-869b-c2999a46991c tempest-VolumesGetTest-573055508 None] Lock "cinder-f05a91f6-99c2-4767-908c-9f4384ba8e6a-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:39 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598" returned: 0 in 1.301s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:40 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598 Jun 03 14:55:40 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:40 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ccdca703-3957-4c22-8ba1-99ebb4a24598" returned: 0 in 0.641s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-ccdca703-3957-4c22-8ba1-99ebb4a24598" released by "delete_volume" :: held 2.021s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:40 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Created reservations ['e834c76c-067a-42f0-a67c-c3fcad39d750', 'eccb46e1-be9d-4026-b86c-e03d7ac167cb', 'c5534431-8a96-41cd-a9cd-6c49e4474732', '7e4e3c81-edf2-46cb-a858-4956739457b6'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:55:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:40 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:40 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:40 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:55:40 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-165bddd2-60aa-4801-949e-12ced68570a4-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Lock "cinder-165bddd2-60aa-4801-949e-12ced68570a4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-quobyte-165bddd2-60aa-4801-949e-12ced68570a4" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-165bddd2-60aa-4801-949e-12ced68570a4" acquired by "delete_volume" :: waited 0.031s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:41 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45861ad-e8ed-4466-92e1-1cde70446272]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:41 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 Jun 03 14:55:41 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:41 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.836s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:41 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:55:41 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Deleted volume successfully. Jun 03 14:55:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-20070b3c-064a-4f9e-a440-70199f5533c3 tempest-VolumesGetTest-573055508 None] Lock "cinder-ccdca703-3957-4c22-8ba1-99ebb4a24598-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:42 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4" returned: 0 in 1.049s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:42 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4 Jun 03 14:55:42 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:42 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-165bddd2-60aa-4801-949e-12ced68570a4" returned: 0 in 0.639s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-165bddd2-60aa-4801-949e-12ced68570a4" released by "delete_volume" :: held 1.756s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:42 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Created reservations ['b189c5e9-0b56-4b19-a564-aebbb9f182db', '85f17bcb-68ce-4350-bb99-75593895eadc', 'f333e392-86a0-420b-b9e9-e90568de794c', '449b7451-eb9b-4b59-8cad-dbc2a43c5754'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:55:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:43 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:55:43 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:43 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.695s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:43 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:55:43 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Deleted volume successfully. Jun 03 14:55:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9dea67a3-b801-4cd6-89c4-fee2561f4b16 tempest-VolumesGetTest-573055508 None] Lock "cinder-165bddd2-60aa-4801-949e-12ced68570a4-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (5b71e05c-6ce3-4cb9-8475-aca42cc5300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca5e8b1-0b62-4827-957f-54f2e585bfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca5e8b1-0b62-4827-957f-54f2e585bfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-210662518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:55:44Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14541314-9848-415d-bd68-1549b571532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14541314-9848-415d-bd68-1549b571532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9692c06e-6dea-487a-a052-60606b191f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.image.glance [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Creating Keystone auth plugin from conf {{(pid=86614) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9692c06e-6dea-487a-a052-60606b191f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2', 'volume_name': 'volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e839bae1-771a-494f-a491-2e77646c9e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e839bae1-771a-494f-a491-2e77646c9e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc4fe61-242c-4a83-8ac2-7b6b3511bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:44 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Volume 2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 03 14:55:44 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Trying to clone 2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 from image 839cbef2-b314-44e2-9fd2-f453c1210770 at location (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]). {{(pid=86614) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 03 14:55:45 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 03 14:55:45 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Image download 20.69 MB at 20.69 MB/s Jun 03 14:55:45 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ef49a8-5b80-45ad-b081-4953d7ce2e75]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:45 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD Jun 03 14:55:45 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:45 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD" returned: 0 in 0.755s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:45 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Temporary image 839cbef2-b314-44e2-9fd2-f453c1210770 is fetched for user 3fdb36ae404a4f8dae645c861c2771e8. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d8d09d-9935-4f81-ac50-682947b2c907]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:46 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD Jun 03 14:55:46 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:46 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD" returned: 0 in 0.669s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-210662518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:55:44Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Creating volume 2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:55:46 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:55:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:46 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 1073741824 Jun 03 14:55:46 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:47 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 1073741824" returned: 0 in 0.756s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:47 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 Jun 03 14:55:47 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:48 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2" returned: 0 in 0.592s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:55:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:48 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Attempting download of 839cbef2-b314-44e2-9fd2-f453c1210770 ((None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}])) to volume 2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 03 14:55:48 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb9389e-23ad-4fe2-93fd-812937d9d228]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_cyxmnk9n {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:48 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_cyxmnk9n Jun 03 14:55:48 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:48 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_cyxmnk9n" returned: 0 in 0.655s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_cyxmnk9n {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:48 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_cyxmnk9n Jun 03 14:55:48 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:49 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_cyxmnk9n" returned: 1 in 0.642s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_cyxmnk9n' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:55:49 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e845dbb6-5e67-45c3-9f06-cb82d9f665c5]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:49 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD Jun 03 14:55:49 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:50 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD" returned: 0 in 0.653s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:50 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] 839cbef2-b314-44e2-9fd2-f453c1210770 was qcow2, converting to raw {{(pid=86614) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 03 14:55:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:50 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 Jun 03 14:55:50 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:51 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2" returned: 0 in 1.785s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:51 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_orzpuq26devstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:55:51 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Converted 112.00 MB image at 62.69 MB/s Jun 03 14:55:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:51 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 1G Jun 03 14:55:51 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:52 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 1G" returned: 0 in 0.617s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:52 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[932c9fa3-3e08-4ea7-b26b-cfb3d06963af]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:52 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 Jun 03 14:55:52 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:53 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2" returned: 0 in 0.670s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:53 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 Jun 03 14:55:53 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:53 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:55:53 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:53 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2" returned: 1 in 0.731s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Downloaded image 839cbef2-b314-44e2-9fd2-f453c1210770 ((None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}])) to volume 2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 successfully. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Temporary image 839cbef2-b314-44e2-9fd2-f453c1210770 for user 3fdb36ae404a4f8dae645c861c2771e8 is deleted. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Marking volume 2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 as bootable. {{(pid=86614) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Copying metadata from image 839cbef2-b314-44e2-9fd2-f453c1210770 to 2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2. {{(pid=86614) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 14:55:53 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Creating volume glance metadata for volume 2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 backed by image 839cbef2-b314-44e2-9fd2-f453c1210770 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86614) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 14:55:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc4fe61-242c-4a83-8ac2-7b6b3511bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2e4f6c-8fe5-448e-b469-a6ae8ccaed4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:54 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Volume volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 (2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2): created successfully Jun 03 14:55:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2e4f6c-8fe5-448e-b469-a6ae8ccaed4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (5b71e05c-6ce3-4cb9-8475-aca42cc5300b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:54 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-dc4d7d4d-9e75-49ae-b5aa-6eb572913f10 tempest-VolumesGetTest-573055508 None] Created volume successfully. Jun 03 14:55:54 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.637s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:55:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:55:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:55:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (42505ac0-d1a9-4cca-b633-049107473150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef546e1-972c-473f-8369-fc2afef4b53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef546e1-972c-473f-8369-fc2afef4b53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:55:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1739463502',display_name='tempest-VolumesGetTest-Volume-503570257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:55:56Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292b1017-afc5-4215-9519-fe31506c4da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292b1017-afc5-4215-9519-fe31506c4da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acfd0d2-5524-4723-8e43-559dc3a524e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acfd0d2-5524-4723-8e43-559dc3a524e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a', 'volume_name': 'volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c143dae8-2254-4c0f-a9bb-c521a3f3c0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c143dae8-2254-4c0f-a9bb-c521a3f3c0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29447084-790d-4d5c-a2a6-c354b7d5c09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:55 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Volume 4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a', 'volume_size': 1} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:55:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1739463502',display_name='tempest-VolumesGetTest-Volume-503570257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7a5b3597db446f8786c1d0d84c5fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:55:56Z,use_quota=True,user_id='3fdb36ae404a4f8dae645c861c2771e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Creating volume 4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:55:55 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:55:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:55 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a 1073741824 Jun 03 14:55:55 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:56 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a 1073741824" returned: 0 in 0.809s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:56 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a Jun 03 14:55:56 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:57 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a" returned: 0 in 0.644s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:55:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29447084-790d-4d5c-a2a6-c354b7d5c09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f2ab68-f705-46c2-a942-d6a9cbce5852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:55:57 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Volume volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a (4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a): created successfully Jun 03 14:55:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f2ab68-f705-46c2-a942-d6a9cbce5852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:55:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Flow 'volume_create_manager' (42505ac0-d1a9-4cca-b633-049107473150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:55:57 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-9cc95e42-c112-4183-b4ad-af668e828053 tempest-VolumesGetTest-573055508 None] Created volume successfully. Jun 03 14:55:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Lock "cinder-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-quobyte-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:55:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:55:58 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e38edd-f1b0-4dac-8ad8-ca60f237ff35]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:55:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:58 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a Jun 03 14:55:58 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:58 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a" returned: 0 in 0.709s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:58 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a Jun 03 14:55:58 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:55:59 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jun 03 14:55:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a" returned: 0 in 0.623s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:55:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a" released by "delete_volume" :: held 1.379s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:55:59 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Created reservations ['6bcaaf1d-feee-4a4e-94b8-891605023404', '58b07f4b-d4be-418f-beff-4757fa3748aa', 'a04260cd-c925-4c84-87c4-efccbd4d4aa4', '187419e3-4115-4406-a1c8-4015bc716c3a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:55:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:55:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:55:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:55:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:55:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:55:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:55:59 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:55:59 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:00 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.585s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:00 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:56:00 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Deleted volume successfully. Jun 03 14:56:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-eb0f9368-d1bb-405b-be61-bd8a6a4a703d tempest-VolumesGetTest-573055508 None] Lock "cinder-4464db9f-bfb0-4ed8-95ef-36a41ffa5d9a-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:56:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:56:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Lock "cinder-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:56:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Acquiring lock "cinder-quobyte-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:56:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:56:00 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f144527-2ee4-4290-93fb-10b0738ba90a]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:56:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:00 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 Jun 03 14:56:00 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:01 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2" returned: 0 in 0.714s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:01 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 Jun 03 14:56:01 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:01 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2" returned: 1 in 0.736s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:56:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:01 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2 Jun 03 14:56:01 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:02 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2" returned: 0 in 0.627s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Lock "cinder-quobyte-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2" released by "delete_volume" :: held 2.140s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:56:02 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Created reservations ['4fae7e96-7946-4034-aeda-e46f1eb0538b', 'c2d36adc-4312-4370-956f-ace423d74a9e', 'cfec7415-e773-4b1d-8f34-bd43f58ae167', '9b17862a-2151-4324-9258-0ad82e1b9c94'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:56:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:56:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:56:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:02 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:56:02 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:03 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.593s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:03 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:56:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Deleted volume successfully. Jun 03 14:56:03 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9981bafa-9a1f-4a42-a393-14f288c1b6ad tempest-VolumesGetTest-573055508 None] Lock "cinder-2eea3b57-4c62-4e83-a9b1-4c8bdf581eb2-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:56:12 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=30,cinder:UPDATE=40,cinder:DELETE=4,cinder:INSERT=15 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:56:13 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=49,cinder:UPDATE=61,cinder:DELETE=4,cinder:INSERT=20 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:56:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-ee75dbf5-229a-4e95-b99b-3b38dd1e2898 req-c599d1aa-82b7-4e1f-b456-dda3aa95ac2d tempest-TestStampPattern-93979479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-ee75dbf5-229a-4e95-b99b-3b38dd1e2898 req-c599d1aa-82b7-4e1f-b456-dda3aa95ac2d tempest-TestStampPattern-93979479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:17 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[f846529a-82ec-42b7-83a1-cc07ac93d6bb]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:56:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-ee75dbf5-229a-4e95-b99b-3b38dd1e2898 req-c599d1aa-82b7-4e1f-b456-dda3aa95ac2d tempest-TestStampPattern-93979479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:18 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 Jun 03 14:56:18 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:18 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-ee75dbf5-229a-4e95-b99b-3b38dd1e2898 req-c599d1aa-82b7-4e1f-b456-dda3aa95ac2d tempest-TestStampPattern-93979479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8" returned: 0 in 0.789s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-ee75dbf5-229a-4e95-b99b-3b38dd1e2898 req-c599d1aa-82b7-4e1f-b456-dda3aa95ac2d tempest-TestStampPattern-93979479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.820s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-ee75dbf5-229a-4e95-b99b-3b38dd1e2898 req-c599d1aa-82b7-4e1f-b456-dda3aa95ac2d tempest-TestStampPattern-93979479 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5ee4f20-39e0-4b4c-88fb-724d6576a046', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:56:18 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-ee75dbf5-229a-4e95-b99b-3b38dd1e2898 req-c599d1aa-82b7-4e1f-b456-dda3aa95ac2d tempest-TestStampPattern-93979479 None] attachment_update completed successfully. Jun 03 14:56:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-f234b96d-434c-4032-87de-f19250a35008 req-273252e4-b983-46a7-9023-494db295c09f tempest-TestStampPattern-93979479 None] Terminate volume connection completed successfully. Jun 03 14:56:25 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-f234b96d-434c-4032-87de-f19250a35008 req-273252e4-b983-46a7-9023-494db295c09f tempest-TestStampPattern-93979479 None] Deleting attachment d5ee4f20-39e0-4b4c-88fb-724d6576a046. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:56:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Acquiring lock "cinder-5f01628c-557e-4fed-8193-cf8d78dd2ba8-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:56:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Lock "cinder-5f01628c-557e-4fed-8193-cf8d78dd2ba8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:56:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Acquiring lock "cinder-quobyte-5f01628c-557e-4fed-8193-cf8d78dd2ba8" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:56:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-5f01628c-557e-4fed-8193-cf8d78dd2ba8" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:56:35 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a16f5b-1d69-405b-accf-0956068b418f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:56:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:35 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 Jun 03 14:56:35 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:35 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8" returned: 0 in 0.693s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:35 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8 Jun 03 14:56:35 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:36 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5f01628c-557e-4fed-8193-cf8d78dd2ba8" returned: 0 in 0.566s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-5f01628c-557e-4fed-8193-cf8d78dd2ba8" released by "delete_volume" :: held 1.297s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:56:36 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Created reservations ['b6dbbc2e-a726-475f-a78d-e0dcdcb68caa', '5887b61d-b6f7-4424-8a88-f4a0a0f4122f', 'd60a6820-f8bc-4b1f-ade5-649bab450148', '84364b9a-2daf-4612-9060-8048671fdf0b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:56:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:56:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:56:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:36 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:56:36 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:37 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.607s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:56:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Deleted volume successfully. Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b02afe26-7ed5-46ec-83cd-b01a88e2cc1a tempest-TestStampPattern-93979479 None] Lock "cinder-5f01628c-557e-4fed-8193-cf8d78dd2ba8-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Acquiring lock "cinder-f288a0df-c8bd-4fa2-8095-69a4498169a3-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Lock "cinder-f288a0df-c8bd-4fa2-8095-69a4498169a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Acquiring lock "cinder-quobyte-3256d379-51b8-4a30-b2b3-85f61c1f8108" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-3256d379-51b8-4a30-b2b3-85f61c1f8108" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Acquiring lock "cinder-quobyte-f288a0df-c8bd-4fa2-8095-69a4498169a3" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-f288a0df-c8bd-4fa2-8095-69a4498169a3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Deleting offline snapshot f288a0df-c8bd-4fa2-8095-69a4498169a3 of volume 3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] snapshot_file for this snap is: volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1739745e-ac6d-418e-b589-cb6a6493529f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:56:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:37 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 Jun 03 14:56:37 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:38 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3" returned: 0 in 0.817s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:38 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3256d379-51b8-4a30-b2b3-85f61c1f8108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:56:38 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7101c607-dfea-45af-920c-5b76f7c10277]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:56:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:38 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 Jun 03 14:56:38 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:39 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108" returned: 0 in 0.781s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:39 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 Jun 03 14:56:39 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:40 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3" returned: 0 in 0.768s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:40 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3 Jun 03 14:56:40 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:40 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108.f288a0df-c8bd-4fa2-8095-69a4498169a3" returned: 0 in 0.669s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-f288a0df-c8bd-4fa2-8095-69a4498169a3" released by "_delete_snapshot" :: held 3.193s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:56:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-3256d379-51b8-4a30-b2b3-85f61c1f8108" released by "delete_snapshot" :: held 3.227s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:56:41 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Created reservations ['2204ad61-659c-40ff-a117-4df5394b2bd8', 'c48fc3ff-fbb1-4ac3-afa6-1e74f2626859', '1b05a331-c3ab-433f-8858-604b2dc91d1e', '90237e8f-5355-4f06-be33-03fe151ed016'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:56:41 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Delete snapshot completed successfully. Jun 03 14:56:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d2e2256c-4b15-4bb8-92d2-06061ed7ca83 tempest-TestStampPattern-93979479 None] Lock "cinder-f288a0df-c8bd-4fa2-8095-69a4498169a3-delete_snapshot" released by "delete_snapshot" :: held 3.379s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Flow 'volume_create_manager' (f43cedd1-0e1b-4245-a1ae-bf10b2d357ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f5fea1-188d-46da-a45e-6b41cd2cb183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f5fea1-188d-46da-a45e-6b41cd2cb183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-103031398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9437243a-7bba-4b89-acdb-d52a9e17019f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd2f55f11e3441f9dbaed8e85574551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:56:47Z,use_quota=True,user_id='f75e806710384c57bb662d49524b00fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d2d859-9bf2-4477-baeb-67648be18617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d2d859-9bf2-4477-baeb-67648be18617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef32b6b-8827-4331-94cb-6f52bfd2aaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef32b6b-8827-4331-94cb-6f52bfd2aaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9437243a-7bba-4b89-acdb-d52a9e17019f', 'volume_name': 'volume-9437243a-7bba-4b89-acdb-d52a9e17019f', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05eb680e-3344-48ba-b84f-dbe484ec404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05eb680e-3344-48ba-b84f-dbe484ec404d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7730876f-437f-4b23-bcd2-cfa54b10820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:47 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Volume 9437243a-7bba-4b89-acdb-d52a9e17019f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9437243a-7bba-4b89-acdb-d52a9e17019f', 'volume_size': 1} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-103031398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9437243a-7bba-4b89-acdb-d52a9e17019f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd2f55f11e3441f9dbaed8e85574551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:56:47Z,use_quota=True,user_id='f75e806710384c57bb662d49524b00fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Creating volume 9437243a-7bba-4b89-acdb-d52a9e17019f {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:56:47 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:56:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:47 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f 1073741824 Jun 03 14:56:47 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:48 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f 1073741824" returned: 0 in 0.829s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:48 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f Jun 03 14:56:48 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:48 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f" returned: 0 in 0.658s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:56:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7730876f-437f-4b23-bcd2-cfa54b10820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9437243a-7bba-4b89-acdb-d52a9e17019f', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c1f2c4-f720-42f3-86ec-b0113fbcf719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:48 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Volume volume-9437243a-7bba-4b89-acdb-d52a9e17019f (9437243a-7bba-4b89-acdb-d52a9e17019f): created successfully Jun 03 14:56:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c1f2c4-f720-42f3-86ec-b0113fbcf719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:48 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Flow 'volume_create_manager' (f43cedd1-0e1b-4245-a1ae-bf10b2d357ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:56:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f1122dfd-f485-426a-84c9-b08ab7c1cdb3 tempest-AttachVolumeTestJSON-747404581 None] Created volume successfully. Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Flow 'volume_create_manager' (ff1d7cb9-49c3-43d8-ab35-5f552a8a1896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16bdb8c-dcc6-4ae3-ba1a-bd0ac5fb00ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16bdb8c-dcc6-4ae3-ba1a-bd0ac5fb00ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1320959484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79036cb-5258-4503-8e62-c109255bd7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c98abc06d1e847cf85c36d1cbb586cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:56:50Z,use_quota=True,user_id='4f2f93bacf084eb09561710eb1345eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc332ba-dabb-409b-83b4-975a46b1010d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc332ba-dabb-409b-83b4-975a46b1010d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052863ca-f491-4a48-8364-4be658f5731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052863ca-f491-4a48-8364-4be658f5731b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79036cb-5258-4503-8e62-c109255bd7dc', 'volume_name': 'volume-f79036cb-5258-4503-8e62-c109255bd7dc', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c7f247-fc55-4e6c-a739-435f77cca859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c7f247-fc55-4e6c-a739-435f77cca859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998e0c9b-fc08-41ef-9711-d3a545ca4b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:49 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Volume f79036cb-5258-4503-8e62-c109255bd7dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79036cb-5258-4503-8e62-c109255bd7dc', 'volume_size': 1} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1320959484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79036cb-5258-4503-8e62-c109255bd7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c98abc06d1e847cf85c36d1cbb586cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:56:50Z,use_quota=True,user_id='4f2f93bacf084eb09561710eb1345eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Creating volume f79036cb-5258-4503-8e62-c109255bd7dc {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:49 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:56:50 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:50 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc 1073741824 Jun 03 14:56:50 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Acquiring lock "cinder-3256d379-51b8-4a30-b2b3-85f61c1f8108-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Lock "cinder-3256d379-51b8-4a30-b2b3-85f61c1f8108-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Acquiring lock "cinder-quobyte-3256d379-51b8-4a30-b2b3-85f61c1f8108" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-3256d379-51b8-4a30-b2b3-85f61c1f8108" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:56:50 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc 1073741824" returned: 0 in 0.865s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[423999d4-29a5-420d-9761-2afe82be5dca]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:50 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc Jun 03 14:56:50 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:50 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 Jun 03 14:56:50 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:51 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc" returned: 0 in 0.659s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:56:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998e0c9b-fc08-41ef-9711-d3a545ca4b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79036cb-5258-4503-8e62-c109255bd7dc', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337839f1-dd6e-481a-bb71-f7c45f8d6513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:51 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Volume volume-f79036cb-5258-4503-8e62-c109255bd7dc (f79036cb-5258-4503-8e62-c109255bd7dc): created successfully Jun 03 14:56:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337839f1-dd6e-481a-bb71-f7c45f8d6513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Flow 'volume_create_manager' (ff1d7cb9-49c3-43d8-ab35-5f552a8a1896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:56:51 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-eb7a72ce-67ae-4bc0-96f1-88756a6a1307 tempest-TestMinimumBasicScenario-1823833033 None] Created volume successfully. Jun 03 14:56:51 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108" returned: 0 in 0.799s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:51 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108 Jun 03 14:56:51 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:52 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-3256d379-51b8-4a30-b2b3-85f61c1f8108" returned: 0 in 0.663s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Lock "cinder-quobyte-3256d379-51b8-4a30-b2b3-85f61c1f8108" released by "delete_volume" :: held 1.537s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Created reservations ['49395697-0588-473b-a85b-c77e9569e664', 'c076a514-9b7e-482c-886e-ec147247912e', '1ad361d2-2551-44a2-abb7-c34446a868ad', 'c5a4d89e-6e62-48b0-a21c-f77c0bae74c1'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-8584c40d-8d02-4c92-9fdc-1b0857d12525 req-fa5cc82e-14ba-4fd7-bac7-4720d8d096e5 tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-8584c40d-8d02-4c92-9fdc-1b0857d12525 req-fa5cc82e-14ba-4fd7-bac7-4720d8d096e5 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[02197e90-5eaa-41dd-9d1a-2c55c8de55b0]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:56:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-8584c40d-8d02-4c92-9fdc-1b0857d12525 req-fa5cc82e-14ba-4fd7-bac7-4720d8d096e5 tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:52 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:56:52 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:52 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f Jun 03 14:56:52 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:53 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.644s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:56:53 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Deleted volume successfully. Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ca96d03e-f18a-4fec-854c-8ac0a06de9ee tempest-TestStampPattern-93979479 None] Lock "cinder-3256d379-51b8-4a30-b2b3-85f61c1f8108-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:56:53 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-8584c40d-8d02-4c92-9fdc-1b0857d12525 req-fa5cc82e-14ba-4fd7-bac7-4720d8d096e5 tempest-AttachVolumeTestJSON-747404581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f" returned: 0 in 0.904s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-8584c40d-8d02-4c92-9fdc-1b0857d12525 req-fa5cc82e-14ba-4fd7-bac7-4720d8d096e5 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.947s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-8584c40d-8d02-4c92-9fdc-1b0857d12525 req-fa5cc82e-14ba-4fd7-bac7-4720d8d096e5 tempest-AttachVolumeTestJSON-747404581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-9437243a-7bba-4b89-acdb-d52a9e17019f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'decbd646-f95f-4e0f-a86e-1c169b299bcb', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:56:53 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-8584c40d-8d02-4c92-9fdc-1b0857d12525 req-fa5cc82e-14ba-4fd7-bac7-4720d8d096e5 tempest-AttachVolumeTestJSON-747404581 None] attachment_update completed successfully. Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:53 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:56:53 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:54 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.774s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:56:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:56:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:56:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:56:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-fd34904d-4ffb-4377-80c0-120dbfbeb9b8 req-b434d9b2-bb18-44e9-8d0e-bb4f905421c7 tempest-TestMinimumBasicScenario-1823833033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-fd34904d-4ffb-4377-80c0-120dbfbeb9b8 req-b434d9b2-bb18-44e9-8d0e-bb4f905421c7 tempest-TestMinimumBasicScenario-1823833033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:55 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[17530f7d-bbaf-4045-9144-a3df8330a228]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:56:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-fd34904d-4ffb-4377-80c0-120dbfbeb9b8 req-b434d9b2-bb18-44e9-8d0e-bb4f905421c7 tempest-TestMinimumBasicScenario-1823833033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:55 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc Jun 03 14:56:55 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:56:56 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jun 03 14:56:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-fd34904d-4ffb-4377-80c0-120dbfbeb9b8 req-b434d9b2-bb18-44e9-8d0e-bb4f905421c7 tempest-TestMinimumBasicScenario-1823833033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc" returned: 0 in 0.769s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:56:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-fd34904d-4ffb-4377-80c0-120dbfbeb9b8 req-b434d9b2-bb18-44e9-8d0e-bb4f905421c7 tempest-TestMinimumBasicScenario-1823833033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.789s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-fd34904d-4ffb-4377-80c0-120dbfbeb9b8 req-b434d9b2-bb18-44e9-8d0e-bb4f905421c7 tempest-TestMinimumBasicScenario-1823833033 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-f79036cb-5258-4503-8e62-c109255bd7dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ba8daf8-b601-497e-9122-d92e7ce3dcd9', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:56:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-fd34904d-4ffb-4377-80c0-120dbfbeb9b8 req-b434d9b2-bb18-44e9-8d0e-bb4f905421c7 tempest-TestMinimumBasicScenario-1823833033 None] attachment_update completed successfully. Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Flow 'volume_create_manager' (820f016c-81d4-4584-a3dc-fb4159286dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d213f032-1f49-4f90-887f-c4e6177c7e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d213f032-1f49-4f90-887f-c4e6177c7e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1296454970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf0a593-f348-4d31-bd44-72096c14c41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd2f55f11e3441f9dbaed8e85574551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:56:59Z,use_quota=True,user_id='f75e806710384c57bb662d49524b00fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88519619-1c90-4210-9003-a52733a09ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88519619-1c90-4210-9003-a52733a09ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb979027-a453-414f-86fc-dcb055640aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb979027-a453-414f-86fc-dcb055640aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf0a593-f348-4d31-bd44-72096c14c41f', 'volume_name': 'volume-9cf0a593-f348-4d31-bd44-72096c14c41f', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a05c90-9f2c-40a5-bbb5-66b5262ab24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a05c90-9f2c-40a5-bbb5-66b5262ab24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f43b1fb-8a6b-4dfc-9b60-1aecb76e42fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:56:59 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Volume 9cf0a593-f348-4d31-bd44-72096c14c41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf0a593-f348-4d31-bd44-72096c14c41f', 'volume_size': 1} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1296454970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf0a593-f348-4d31-bd44-72096c14c41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd2f55f11e3441f9dbaed8e85574551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:56:59Z,use_quota=True,user_id='f75e806710384c57bb662d49524b00fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Creating volume 9cf0a593-f348-4d31-bd44-72096c14c41f {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:56:59 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:56:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:56:59 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f 1073741824 Jun 03 14:56:59 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:00 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f 1073741824" returned: 0 in 1.032s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:00 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f Jun 03 14:57:00 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:01 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f" returned: 0 in 0.746s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f43b1fb-8a6b-4dfc-9b60-1aecb76e42fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf0a593-f348-4d31-bd44-72096c14c41f', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e34598d-7ff3-4766-8c0f-a07b65e154e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:01 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Volume volume-9cf0a593-f348-4d31-bd44-72096c14c41f (9cf0a593-f348-4d31-bd44-72096c14c41f): created successfully Jun 03 14:57:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e34598d-7ff3-4766-8c0f-a07b65e154e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Flow 'volume_create_manager' (820f016c-81d4-4584-a3dc-fb4159286dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:01 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-65d7e224-3894-4cd8-8241-d4ef95b6111e tempest-AttachVolumeTestJSON-747404581 None] Created volume successfully. Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Flow 'volume_create_manager' (6b21fa2d-4657-42b5-843c-a95dc539449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b8d4a4-585a-4af9-acfc-8f520045af62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b8d4a4-585a-4af9-acfc-8f520045af62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613433419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74901c3-5d39-416d-8aaa-65475fb33c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3000bee1a4fc9808484997a184c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:05Z,use_quota=True,user_id='8bd9ba4a13d1498ea04cc012422b8b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a53d70-9b1d-4999-8908-e38fc3b82dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a53d70-9b1d-4999-8908-e38fc3b82dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370bf1b8-daab-4882-882c-fe920f713b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370bf1b8-daab-4882-882c-fe920f713b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74901c3-5d39-416d-8aaa-65475fb33c38', 'volume_name': 'volume-f74901c3-5d39-416d-8aaa-65475fb33c38', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ed0eeb-b79f-4226-9e26-b6daf07b5cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ed0eeb-b79f-4226-9e26-b6daf07b5cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3422c87d-c2ca-49ac-808e-470e0d07f098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:05 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Volume f74901c3-5d39-416d-8aaa-65475fb33c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74901c3-5d39-416d-8aaa-65475fb33c38', 'volume_size': 1} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613433419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74901c3-5d39-416d-8aaa-65475fb33c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3000bee1a4fc9808484997a184c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:05Z,use_quota=True,user_id='8bd9ba4a13d1498ea04cc012422b8b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Creating volume f74901c3-5d39-416d-8aaa-65475fb33c38 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:05 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:05 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38 1073741824 Jun 03 14:57:05 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Flow 'volume_create_manager' (dad2a7a7-ec7b-4910-838c-7d599f7a9ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fea5e71-132d-4c36-a5f7-69d7ba4c08ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fea5e71-132d-4c36-a5f7-69d7ba4c08ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922433203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175141dc-5384-4db6-9240-95282a0c8fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3000bee1a4fc9808484997a184c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:05Z,use_quota=True,user_id='8bd9ba4a13d1498ea04cc012422b8b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e6c849-9dc0-4fd4-9031-cfce086f589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e6c849-9dc0-4fd4-9031-cfce086f589e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6490c39f-2670-4b48-9de7-2ba8ff1e935c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6490c39f-2670-4b48-9de7-2ba8ff1e935c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175141dc-5384-4db6-9240-95282a0c8fb5', 'volume_name': 'volume-175141dc-5384-4db6-9240-95282a0c8fb5', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac83eb7-ce52-4349-b88e-4ffaf57f6def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac83eb7-ce52-4349-b88e-4ffaf57f6def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66786bf7-91ea-415e-b9cd-3df99bf64f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:05 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Volume 175141dc-5384-4db6-9240-95282a0c8fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175141dc-5384-4db6-9240-95282a0c8fb5', 'volume_size': 1} Jun 03 14:57:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-004d0455-12e4-4a0f-b940-559c736df254 req-4f671679-32a7-4752-95bc-ad7bde148bea tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Flow 'volume_create_manager' (cf616986-62be-4a41-82ef-bd7b23585711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fbf963-a889-4df5-be1f-3d80f4a3716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fbf963-a889-4df5-be1f-3d80f4a3716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-380686664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b24eac-512a-4166-9a91-a568f878dd31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3000bee1a4fc9808484997a184c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:06Z,use_quota=True,user_id='8bd9ba4a13d1498ea04cc012422b8b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134e7b58-20ff-4c63-8270-77d9aa657fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134e7b58-20ff-4c63-8270-77d9aa657fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bb25c5-5bd5-4e0e-ba29-a91cbbad0069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bb25c5-5bd5-4e0e-ba29-a91cbbad0069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b24eac-512a-4166-9a91-a568f878dd31', 'volume_name': 'volume-b3b24eac-512a-4166-9a91-a568f878dd31', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891bea29-95e7-43c9-a18f-8ba2f96515d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891bea29-95e7-43c9-a18f-8ba2f96515d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f6ce87-2039-45d3-af29-1f16061a6066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:06 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Volume b3b24eac-512a-4166-9a91-a568f878dd31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b24eac-512a-4166-9a91-a568f878dd31', 'volume_size': 1} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:06 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38 1073741824" returned: 0 in 1.474s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:06 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38 Jun 03 14:57:06 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Flow 'volume_create_manager' (638b53f3-e1fc-447e-aad4-824fc831de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329b6393-16a9-4868-b393-c1b6ae5d5a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329b6393-16a9-4868-b393-c1b6ae5d5a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1315309785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d8c9b4-b31e-4dcc-aff4-1349b93b1be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3000bee1a4fc9808484997a184c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:07Z,use_quota=True,user_id='8bd9ba4a13d1498ea04cc012422b8b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27afbfa8-5fb5-4105-8ef8-2871acb37e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27afbfa8-5fb5-4105-8ef8-2871acb37e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff7b254-c57d-4313-b86a-15cfdd39513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff7b254-c57d-4313-b86a-15cfdd39513e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d8c9b4-b31e-4dcc-aff4-1349b93b1be3', 'volume_name': 'volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc70147-65b2-43e8-9d5c-1fa53637878b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:06 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc70147-65b2-43e8-9d5c-1fa53637878b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7c36e3-601a-486b-bc43-fc961870b389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:07 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Volume 05d8c9b4-b31e-4dcc-aff4-1349b93b1be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3', 'volume_size': 1} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Flow 'volume_create_manager' (4c48197a-974f-4dcb-ae9d-0728fb49935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ddecc34-9f94-44e8-9567-54a05482cc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ddecc34-9f94-44e8-9567-54a05482cc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1496018904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7f8b2d-b355-464e-8e4c-4117c735023c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3000bee1a4fc9808484997a184c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:07Z,use_quota=True,user_id='8bd9ba4a13d1498ea04cc012422b8b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2666dbf9-e866-4a2e-9007-2788c8a27745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2666dbf9-e866-4a2e-9007-2788c8a27745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c90a447-d8ec-46e2-9556-7d82e97efa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c90a447-d8ec-46e2-9556-7d82e97efa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7f8b2d-b355-464e-8e4c-4117c735023c', 'volume_name': 'volume-5e7f8b2d-b355-464e-8e4c-4117c735023c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c37eb7-473f-4f43-a459-6cea0c72e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c37eb7-473f-4f43-a459-6cea0c72e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85805e4f-3f87-40bc-8655-e3663c9187a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:07 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Volume 5e7f8b2d-b355-464e-8e4c-4117c735023c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7f8b2d-b355-464e-8e4c-4117c735023c', 'volume_size': 1} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:07 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38" returned: 0 in 0.861s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.393s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922433203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175141dc-5384-4db6-9240-95282a0c8fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3000bee1a4fc9808484997a184c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:05Z,use_quota=True,user_id='8bd9ba4a13d1498ea04cc012422b8b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Creating volume 175141dc-5384-4db6-9240-95282a0c8fb5 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:07 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:07 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5 1073741824 Jun 03 14:57:07 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3422c87d-c2ca-49ac-808e-470e0d07f098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74901c3-5d39-416d-8aaa-65475fb33c38', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03620a27-b218-4a45-a3df-053eb12e99d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:07 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Volume volume-f74901c3-5d39-416d-8aaa-65475fb33c38 (f74901c3-5d39-416d-8aaa-65475fb33c38): created successfully Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03620a27-b218-4a45-a3df-053eb12e99d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Flow 'volume_create_manager' (6b21fa2d-4657-42b5-843c-a95dc539449f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:07 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c918e441-9190-4523-8d8d-139488ceac72 tempest-CreateVolumesFromImageTest-1443547572 None] Created volume successfully. Jun 03 14:57:08 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5 1073741824" returned: 0 in 0.883s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:08 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5 Jun 03 14:57:08 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:09 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5" returned: 0 in 0.645s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-004d0455-12e4-4a0f-b940-559c736df254 req-4f671679-32a7-4752-95bc-ad7bde148bea tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.945s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66786bf7-91ea-415e-b9cd-3df99bf64f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175141dc-5384-4db6-9240-95282a0c8fb5', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e9e938-5d1e-4000-8a69-eda1318097f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d139e43-18ff-4b14-bc48-a3473ca7557c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-004d0455-12e4-4a0f-b940-559c736df254 req-4f671679-32a7-4752-95bc-ad7bde148bea tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:09 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Volume volume-175141dc-5384-4db6-9240-95282a0c8fb5 (175141dc-5384-4db6-9240-95282a0c8fb5): created successfully Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e9e938-5d1e-4000-8a69-eda1318097f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Flow 'volume_create_manager' (dad2a7a7-ec7b-4910-838c-7d599f7a9ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:09 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-fe50daf7-da18-44e1-b615-b1b6855dc4e3 tempest-CreateVolumesFromImageTest-1443547572 None] Created volume successfully. Jun 03 14:57:09 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f Jun 03 14:57:09 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:09 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-004d0455-12e4-4a0f-b940-559c736df254 req-4f671679-32a7-4752-95bc-ad7bde148bea tempest-AttachVolumeTestJSON-747404581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f" returned: 0 in 0.711s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-004d0455-12e4-4a0f-b940-559c736df254 req-4f671679-32a7-4752-95bc-ad7bde148bea tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.741s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.435s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-380686664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b24eac-512a-4166-9a91-a568f878dd31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3000bee1a4fc9808484997a184c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:06Z,use_quota=True,user_id='8bd9ba4a13d1498ea04cc012422b8b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Creating volume b3b24eac-512a-4166-9a91-a568f878dd31 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:09 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:09 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31 1073741824 Jun 03 14:57:09 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-004d0455-12e4-4a0f-b940-559c736df254 req-4f671679-32a7-4752-95bc-ad7bde148bea tempest-AttachVolumeTestJSON-747404581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-9cf0a593-f348-4d31-bd44-72096c14c41f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '201641ff-da05-4b87-9f87-02f52effbc3f', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:57:09 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-004d0455-12e4-4a0f-b940-559c736df254 req-4f671679-32a7-4752-95bc-ad7bde148bea tempest-AttachVolumeTestJSON-747404581 None] attachment_update completed successfully. Jun 03 14:57:10 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31 1073741824" returned: 0 in 0.805s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:10 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31 Jun 03 14:57:10 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:11 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31" returned: 0 in 0.633s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.337s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1315309785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d8c9b4-b31e-4dcc-aff4-1349b93b1be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3000bee1a4fc9808484997a184c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:07Z,use_quota=True,user_id='8bd9ba4a13d1498ea04cc012422b8b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Creating volume 05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:11 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f6ce87-2039-45d3-af29-1f16061a6066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b24eac-512a-4166-9a91-a568f878dd31', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:11 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 1073741824 Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cbb6cf-52cd-4e74-8ca6-daa5a17834c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:11 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:11 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Volume volume-b3b24eac-512a-4166-9a91-a568f878dd31 (b3b24eac-512a-4166-9a91-a568f878dd31): created successfully Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cbb6cf-52cd-4e74-8ca6-daa5a17834c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Flow 'volume_create_manager' (cf616986-62be-4a41-82ef-bd7b23585711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:11 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-30ea3663-40c6-401b-b83a-cfb6bb60a48a tempest-CreateVolumesFromImageTest-1443547572 None] Created volume successfully. Jun 03 14:57:12 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 1073741824" returned: 0 in 0.805s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:12 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 Jun 03 14:57:12 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:12 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3" returned: 0 in 0.635s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.361s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1496018904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7f8b2d-b355-464e-8e4c-4117c735023c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3000bee1a4fc9808484997a184c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:07Z,use_quota=True,user_id='8bd9ba4a13d1498ea04cc012422b8b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Creating volume 5e7f8b2d-b355-464e-8e4c-4117c735023c {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:12 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=52,cinder:UPDATE=46,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7c36e3-601a-486b-bc43-fc961870b389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fe65ce-2baf-449b-90f5-6fde4295020c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:12 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c 1073741824 Jun 03 14:57:12 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:12 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Volume volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 (05d8c9b4-b31e-4dcc-aff4-1349b93b1be3): created successfully Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fe65ce-2baf-449b-90f5-6fde4295020c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Flow 'volume_create_manager' (638b53f3-e1fc-447e-aad4-824fc831de96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:12 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4144d2ed-8d72-41df-9d79-7ba5ea5c9858 tempest-CreateVolumesFromImageTest-1443547572 None] Created volume successfully. Jun 03 14:57:13 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c 1073741824" returned: 0 in 0.793s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:13 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=57,cinder:UPDATE=53,cinder:INSERT=9,cinder:DELETE=6 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:57:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:13 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c Jun 03 14:57:13 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:14 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c" returned: 0 in 0.628s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85805e4f-3f87-40bc-8655-e3663c9187a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7f8b2d-b355-464e-8e4c-4117c735023c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5cd2981-6e28-4d66-a508-49793a72467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:14 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Volume volume-5e7f8b2d-b355-464e-8e4c-4117c735023c (5e7f8b2d-b355-464e-8e4c-4117c735023c): created successfully Jun 03 14:57:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5cd2981-6e28-4d66-a508-49793a72467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Flow 'volume_create_manager' (4c48197a-974f-4dcb-ae9d-0728fb49935f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:14 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4ddab1f9-119b-4dff-88bf-0cc0473b5817 tempest-CreateVolumesFromImageTest-1443547572 None] Created volume successfully. Jun 03 14:57:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "cinder-5e7f8b2d-b355-464e-8e4c-4117c735023c-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-5e7f8b2d-b355-464e-8e4c-4117c735023c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "cinder-quobyte-5e7f8b2d-b355-464e-8e4c-4117c735023c" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-quobyte-5e7f8b2d-b355-464e-8e4c-4117c735023c" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:15 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e5ab03-f31d-44a3-967f-d79bad437a21]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:15 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c Jun 03 14:57:15 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:15 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c" returned: 0 in 0.750s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:15 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c Jun 03 14:57:15 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:16 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-b558446a-e971-438b-8c8e-5f2508272f3b req-d054b185-4fa5-487c-ba50-c5ddd1fc4f97 tempest-AttachVolumeTestJSON-747404581 None] Terminate volume connection completed successfully. Jun 03 14:57:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-b558446a-e971-438b-8c8e-5f2508272f3b req-d054b185-4fa5-487c-ba50-c5ddd1fc4f97 tempest-AttachVolumeTestJSON-747404581 None] Deleting attachment decbd646-f95f-4e0f-a86e-1c169b299bcb. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:57:16 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5e7f8b2d-b355-464e-8e4c-4117c735023c" returned: 0 in 0.606s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-quobyte-5e7f8b2d-b355-464e-8e4c-4117c735023c" released by "delete_volume" :: held 1.399s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:16 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Created reservations ['fb614f64-f713-4d28-aad4-99c5e482d778', '1f860b48-4af6-4478-954f-1deb37199756', 'e887c376-0251-4863-8580-948ed25c5d65', '16f37b95-40ce-4b68-b363-b8ee1baf2bb7'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:16 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:16 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:17 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.583s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:17 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:17 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Deleted volume successfully. Jun 03 14:57:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-afc2e192-7325-4c2c-8717-b0ea27946a13 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-5e7f8b2d-b355-464e-8e4c-4117c735023c-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "cinder-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "cinder-quobyte-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-quobyte-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:17 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d41ee9a-a2da-4637-8c68-bf7101539a6a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:17 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 Jun 03 14:57:17 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:18 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3" returned: 0 in 0.703s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:18 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3 Jun 03 14:57:18 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:18 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-8c308dc7-a9b0-41a1-82a1-236121427f8e req-f0bc5d89-b88a-45e3-ae9f-cdcb5a2d13bb tempest-AttachVolumeTestJSON-747404581 None] Terminate volume connection completed successfully. Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-8c308dc7-a9b0-41a1-82a1-236121427f8e req-f0bc5d89-b88a-45e3-ae9f-cdcb5a2d13bb tempest-AttachVolumeTestJSON-747404581 None] Deleting attachment 201641ff-da05-4b87-9f87-02f52effbc3f. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:57:18 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3" returned: 0 in 0.606s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-quobyte-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3" released by "delete_volume" :: held 1.348s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Created reservations ['05acc682-d569-4f67-a4c9-83b6439effbb', '7928c0d9-c0db-48bc-9f63-5371d8c62a74', '4c549561-6647-47f1-8e9a-5fabad8cbf39', 'e3cb7ffc-3502-45e8-bc62-ad8d3d5f05c0'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:18 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:18 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:19 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.588s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:19 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:19 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Deleted volume successfully. Jun 03 14:57:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bcf7670e-3a24-4782-b4cb-f440fbc3080c tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-05d8c9b4-b31e-4dcc-aff4-1349b93b1be3-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "cinder-b3b24eac-512a-4166-9a91-a568f878dd31-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-b3b24eac-512a-4166-9a91-a568f878dd31-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "cinder-quobyte-b3b24eac-512a-4166-9a91-a568f878dd31" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-quobyte-b3b24eac-512a-4166-9a91-a568f878dd31" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:19 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b017c78-9140-4068-8d3d-9869b1b27c0a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:19 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31 Jun 03 14:57:19 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:20 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31" returned: 0 in 0.733s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:20 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31 Jun 03 14:57:20 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:20 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b3b24eac-512a-4166-9a91-a568f878dd31" returned: 0 in 0.615s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-quobyte-b3b24eac-512a-4166-9a91-a568f878dd31" released by "delete_volume" :: held 1.394s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Created reservations ['3077daa6-c01f-402a-9fb4-542bca4ea58a', 'c825b3ac-5e66-40ca-b388-66763bff56bb', '1776379f-0680-4d89-bc15-331fea9e8d37', '3413e623-fe80-485c-becb-f130316b9753'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:21 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:21 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:21 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.597s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Deleted volume successfully. Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7b2efe62-5814-4a4b-b360-101c99ac5d01 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-b3b24eac-512a-4166-9a91-a568f878dd31-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "cinder-175141dc-5384-4db6-9240-95282a0c8fb5-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-175141dc-5384-4db6-9240-95282a0c8fb5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "cinder-quobyte-175141dc-5384-4db6-9240-95282a0c8fb5" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-quobyte-175141dc-5384-4db6-9240-95282a0c8fb5" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5341e4-c47f-4c1d-a855-9f7a4935d573]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:21 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5 Jun 03 14:57:21 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:22 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5" returned: 0 in 1.122s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:22 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5 Jun 03 14:57:22 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:23 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-175141dc-5384-4db6-9240-95282a0c8fb5" returned: 0 in 0.729s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-quobyte-175141dc-5384-4db6-9240-95282a0c8fb5" released by "delete_volume" :: held 1.915s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:23 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Created reservations ['56f2cf7f-2bfd-437d-b58b-dcd41043b7d4', '635a8d7c-1d9b-4370-85c4-383a150118ef', '0824b68b-9eda-41b4-b755-eb166db43cb2', '334e484e-dbb2-47db-96aa-d00e4c1c709f'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:24 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:24 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "cinder-f74901c3-5d39-416d-8aaa-65475fb33c38-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-f74901c3-5d39-416d-8aaa-65475fb33c38-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "cinder-quobyte-f74901c3-5d39-416d-8aaa-65475fb33c38" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-quobyte-f74901c3-5d39-416d-8aaa-65475fb33c38" acquired by "delete_volume" :: waited 0.044s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[440a2999-9c3e-409d-8214-abfaf093741a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:24 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38 Jun 03 14:57:24 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:25 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.138s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:25 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Deleted volume successfully. Jun 03 14:57:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ef9a9a89-5367-4c3e-a2e9-9cd53e9863d3 tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-175141dc-5384-4db6-9240-95282a0c8fb5-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:25 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38" returned: 0 in 1.032s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:25 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38 Jun 03 14:57:25 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:26 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f74901c3-5d39-416d-8aaa-65475fb33c38" returned: 0 in 0.656s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-quobyte-f74901c3-5d39-416d-8aaa-65475fb33c38" released by "delete_volume" :: held 1.763s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Created reservations ['8bbcd005-cd3f-4a5a-a639-f37ca1ba86b0', '2b34b1a9-7aa2-40ce-aac4-4867ac58ae34', '5df69bdc-80d7-4243-8730-017e7be9d5c1', '85ef2c59-b4d6-487e-bd23-0c4a9e4a6fef'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:26 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:26 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:26 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.683s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:26 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Deleted volume successfully. Jun 03 14:57:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ea234b65-6f45-4985-a791-c1165bdd960f tempest-CreateVolumesFromImageTest-1443547572 None] Lock "cinder-f74901c3-5d39-416d-8aaa-65475fb33c38-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (8daefbbf-fc3c-472b-b4ca-292b73cf23e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f83891-5c71-4348-9b0c-a61cfae9bcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f83891-5c71-4348-9b0c-a61cfae9bcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531917127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e647901e-7342-41ca-a0b6-f968d93df345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:29Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47fc8f2-81b1-4bde-9034-41d83fbbacc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47fc8f2-81b1-4bde-9034-41d83fbbacc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6159f1f9-4ee5-4298-8bc2-cca042097bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6159f1f9-4ee5-4298-8bc2-cca042097bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e647901e-7342-41ca-a0b6-f968d93df345', 'volume_name': 'volume-e647901e-7342-41ca-a0b6-f968d93df345', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16406b93-f69a-44d0-bc91-e20e21d0a612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16406b93-f69a-44d0-bc91-e20e21d0a612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28157e0-8c58-4d9a-9e6c-e1129385bd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:29 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume e647901e-7342-41ca-a0b6-f968d93df345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e647901e-7342-41ca-a0b6-f968d93df345', 'volume_size': 1} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531917127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e647901e-7342-41ca-a0b6-f968d93df345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:29Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Creating volume e647901e-7342-41ca-a0b6-f968d93df345 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:29 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:29 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 1073741824 Jun 03 14:57:29 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "cinder-9cf0a593-f348-4d31-bd44-72096c14c41f-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-9cf0a593-f348-4d31-bd44-72096c14c41f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "cinder-quobyte-9cf0a593-f348-4d31-bd44-72096c14c41f" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:30 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 1073741824" returned: 0 in 0.851s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-quobyte-9cf0a593-f348-4d31-bd44-72096c14c41f" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:30 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc781a3-2085-47a5-9369-82e607ef11cd]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:30 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 Jun 03 14:57:30 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:30 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f Jun 03 14:57:30 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:31 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345" returned: 0 in 0.598s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28157e0-8c58-4d9a-9e6c-e1129385bd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e647901e-7342-41ca-a0b6-f968d93df345', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9704fd90-2202-4232-a32c-7bc6e8d5e3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:31 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume volume-e647901e-7342-41ca-a0b6-f968d93df345 (e647901e-7342-41ca-a0b6-f968d93df345): created successfully Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9704fd90-2202-4232-a32c-7bc6e8d5e3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (8daefbbf-fc3c-472b-b4ca-292b73cf23e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7b48ee69-fe4a-4231-8a1b-e675cbaeb6b5 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created volume successfully. Jun 03 14:57:31 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f" returned: 0 in 0.725s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:31 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f Jun 03 14:57:31 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Creating offline snapshot 6137357a-443e-488f-b79b-a1168f9e20e9 of volume e647901e-7342-41ca-a0b6-f968d93df345 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ebb3bc-1884-4b10-ad94-4ce4361b1324]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:31 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9cf0a593-f348-4d31-bd44-72096c14c41f" returned: 0 in 0.674s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-quobyte-9cf0a593-f348-4d31-bd44-72096c14c41f" released by "delete_volume" :: held 1.462s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:31 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Created reservations ['a0b49c8a-1742-4055-95f8-c68f5b0aa180', 'd93f9701-1e38-494b-8bcb-5bfbaf60eb86', '62019f52-c09a-472a-bb1e-d805622db4a3', 'da53bdff-a658-460c-890f-e1e9ef8fa6c0'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:31 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 Jun 03 14:57:31 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:32 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:32 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "cinder-9437243a-7bba-4b89-acdb-d52a9e17019f-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-9437243a-7bba-4b89-acdb-d52a9e17019f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:32 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.636s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:32 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Deleted volume successfully. Jun 03 14:57:32 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345" returned: 0 in 0.851s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:32 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 1G Jun 03 14:57:32 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "cinder-quobyte-9437243a-7bba-4b89-acdb-d52a9e17019f" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-quobyte-9437243a-7bba-4b89-acdb-d52a9e17019f" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-194115a1-7c9c-4540-b243-f01a0abe7148 tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-9cf0a593-f348-4d31-bd44-72096c14c41f-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a68e9b-126d-4578-99af-4a08e62843ff]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:32 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f Jun 03 14:57:32 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:33 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 1G" returned: 0 in 0.822s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e647901e-7342-41ca-a0b6-f968d93df345 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:33 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e647901e-7342-41ca-a0b6-f968d93df345 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 Jun 03 14:57:33 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:33 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f" returned: 0 in 0.745s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:33 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f Jun 03 14:57:33 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:34 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9437243a-7bba-4b89-acdb-d52a9e17019f" returned: 0 in 0.661s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-quobyte-9437243a-7bba-4b89-acdb-d52a9e17019f" released by "delete_volume" :: held 1.473s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:34 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e647901e-7342-41ca-a0b6-f968d93df345 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9" returned: 0 in 0.796s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:34 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 is being set with open permissions: ugo+rw Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:34 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 Jun 03 14:57:34 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Created reservations ['ff5629a6-2919-485a-9858-c010df9bb0b6', '5d1500e2-d960-4eba-b3ba-afadbfe7d3db', 'a922e1a7-b44f-4908-aba5-b0e056f47755', '4f01e672-411a-4e96-b70d-c3a50461e687'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:34 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:34 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:34 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9" returned: 0 in 0.641s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:35 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.info Jun 03 14:57:35 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "cinder-052c3ed5-2a1a-4943-977e-c10f6f38c09a-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-052c3ed5-2a1a-4943-977e-c10f6f38c09a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:35 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.681s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:35 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Deleted volume successfully. Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "cinder-quobyte-052c3ed5-2a1a-4943-977e-c10f6f38c09a" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-985dd8ab-76d1-4bf0-a20e-94ea3c793abe tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-9437243a-7bba-4b89-acdb-d52a9e17019f-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-quobyte-052c3ed5-2a1a-4943-977e-c10f6f38c09a" acquired by "delete_volume" :: waited 0.028s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a29f9c-838f-4f17-a741-2b5f2b5d246c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:35 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a Jun 03 14:57:35 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:35 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.info" returned: 0 in 0.672s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:35 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.info is being set with open permissions: ugo+rw Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:35 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.info Jun 03 14:57:35 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:35 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a" returned: 0 in 0.743s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:35 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a Jun 03 14:57:35 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:36 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.info" returned: 0 in 0.615s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.497s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:36 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7a514899-4e84-43aa-bdd1-2ba42b7acc23 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Create snapshot completed successfully Jun 03 14:57:36 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-052c3ed5-2a1a-4943-977e-c10f6f38c09a" returned: 0 in 0.586s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-quobyte-052c3ed5-2a1a-4943-977e-c10f6f38c09a" released by "delete_volume" :: held 1.370s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Created reservations ['4388f494-5456-4af6-bba3-50102a14cb9f', 'ad01c717-b2a3-4208-8a93-23dac3a3458e', '6c00501e-2f6a-4f2e-926d-51af5fd49e41', 'c83a1df8-6ac9-40f1-83a5-7467b57e8495'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:36 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:36 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:37 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.659s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Deleted volume successfully. Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-169885ed-46a2-4399-a9b2-18e768df465e tempest-AttachVolumeTestJSON-747404581 None] Lock "cinder-052c3ed5-2a1a-4943-977e-c10f6f38c09a-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (581911e9-d554-4eea-84ff-73c9c4f2ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8b61d5-eb0a-42e8-a770-118117a1da25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8b61d5-eb0a-42e8-a770-118117a1da25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-749416932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914fd79b-a710-48b2-9b6f-e7439f89da88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:37Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2d69a0-41d3-4aee-9271-ae9e6a670596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2d69a0-41d3-4aee-9271-ae9e6a670596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf22c16a-0d62-4e0d-b9fe-72765f1434c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf22c16a-0d62-4e0d-b9fe-72765f1434c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914fd79b-a710-48b2-9b6f-e7439f89da88', 'volume_name': 'volume-914fd79b-a710-48b2-9b6f-e7439f89da88', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1769d875-8968-4f1e-83e9-c091eda20d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1769d875-8968-4f1e-83e9-c091eda20d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6745ba3-e5bb-4931-9099-d868519951a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:37 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume 914fd79b-a710-48b2-9b6f-e7439f89da88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914fd79b-a710-48b2-9b6f-e7439f89da88', 'volume_size': 1} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-749416932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914fd79b-a710-48b2-9b6f-e7439f89da88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:37Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Creating volume 914fd79b-a710-48b2-9b6f-e7439f89da88 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:37 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:37 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88 1073741824 Jun 03 14:57:37 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (786d18ec-d803-40c3-aa37-4351bdc11a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6b8588-b5d7-424e-932d-020b318808c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6b8588-b5d7-424e-932d-020b318808c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-710901160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c39393-d353-40b3-a9b1-7dca7f84bef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:38Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44eb2898-42aa-4326-a0fd-625c866b9a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44eb2898-42aa-4326-a0fd-625c866b9a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e5d291-e919-489b-b0c7-a6b46cdb1743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e5d291-e919-489b-b0c7-a6b46cdb1743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c39393-d353-40b3-a9b1-7dca7f84bef6', 'volume_name': 'volume-70c39393-d353-40b3-a9b1-7dca7f84bef6', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed34b9f-17d0-4249-9b5d-e0369f01bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed34b9f-17d0-4249-9b5d-e0369f01bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c568ca2e-fd64-4eff-9e42-95878115d24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume 70c39393-d353-40b3-a9b1-7dca7f84bef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c39393-d353-40b3-a9b1-7dca7f84bef6', 'volume_size': 1} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (e94f49a5-ef68-4a79-babb-c0f83ea28dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa3b286-2c9f-4e9b-9e17-7041a3cbe379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa3b286-2c9f-4e9b-9e17-7041a3cbe379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1881627026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9134e9-e715-47b5-85ed-8060118b7aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:38Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bd9994-6465-4dc6-aebc-af4d382da6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bd9994-6465-4dc6-aebc-af4d382da6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc377010-1a04-4ed1-b790-ca927cb6e99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc377010-1a04-4ed1-b790-ca927cb6e99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9134e9-e715-47b5-85ed-8060118b7aab', 'volume_name': 'volume-cf9134e9-e715-47b5-85ed-8060118b7aab', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbfa3ca-8c29-4897-a381-e82edc112207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbfa3ca-8c29-4897-a381-e82edc112207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6463f4-2839-4ee0-b63f-1340089ac78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume cf9134e9-e715-47b5-85ed-8060118b7aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9134e9-e715-47b5-85ed-8060118b7aab', 'volume_size': 1} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:38 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (bc96c70d-d400-4e90-84ea-d9884e60d346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b137527e-62f8-4550-bff4-91c662b2b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88 1073741824" returned: 0 in 1.120s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b137527e-62f8-4550-bff4-91c662b2b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-99640300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be411930-e67b-4e25-8776-d4f251d4ef8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:39Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0552d0b2-f437-4c6c-8b6a-88ee2505fc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0552d0b2-f437-4c6c-8b6a-88ee2505fc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e455baf-539f-42fb-9541-17a59fd3d40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e455baf-539f-42fb-9541-17a59fd3d40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be411930-e67b-4e25-8776-d4f251d4ef8f', 'volume_name': 'volume-be411930-e67b-4e25-8776-d4f251d4ef8f', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30aa8b5-3281-492c-9546-1a5f8f8eac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30aa8b5-3281-492c-9546-1a5f8f8eac39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a17fda-3986-4ce0-aee0-994da966d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:38 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume be411930-e67b-4e25-8776-d4f251d4ef8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be411930-e67b-4e25-8776-d4f251d4ef8f', 'volume_size': 1} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:38 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88 Jun 03 14:57:38 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (5b7e205e-5700-470e-933a-37b43012a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e19b724-692f-4b11-a494-21f7bd36f9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e19b724-692f-4b11-a494-21f7bd36f9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-947704974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981b8fb9-0804-4cbc-95ad-593ad943564c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:39Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c0dbfc-50b6-4788-80f9-85b208a495d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c0dbfc-50b6-4788-80f9-85b208a495d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d22588-825c-4046-9f03-924441517a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d22588-825c-4046-9f03-924441517a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981b8fb9-0804-4cbc-95ad-593ad943564c', 'volume_name': 'volume-981b8fb9-0804-4cbc-95ad-593ad943564c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c6a891-db17-4fae-9ce1-f14bf91b1191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c6a891-db17-4fae-9ce1-f14bf91b1191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52271ba-0789-4cd3-bf28-8e734df84b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:39 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume 981b8fb9-0804-4cbc-95ad-593ad943564c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981b8fb9-0804-4cbc-95ad-593ad943564c', 'volume_size': 1} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:39 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88" returned: 0 in 0.753s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.621s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-710901160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c39393-d353-40b3-a9b1-7dca7f84bef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:38Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Creating volume 70c39393-d353-40b3-a9b1-7dca7f84bef6 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:39 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6745ba3-e5bb-4931-9099-d868519951a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914fd79b-a710-48b2-9b6f-e7439f89da88', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:39 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6 1073741824 Jun 03 14:57:39 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa68029-bfbe-427e-9204-0f9725c81afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:39 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume volume-914fd79b-a710-48b2-9b6f-e7439f89da88 (914fd79b-a710-48b2-9b6f-e7439f89da88): created successfully Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa68029-bfbe-427e-9204-0f9725c81afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (581911e9-d554-4eea-84ff-73c9c4f2ca04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-cb672794-8b95-4bf3-a239-63b1a8ca30ab tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created volume successfully. Jun 03 14:57:40 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6 1073741824" returned: 0 in 0.823s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:40 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6 Jun 03 14:57:40 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:41 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6" returned: 0 in 0.652s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.705s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1881627026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9134e9-e715-47b5-85ed-8060118b7aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:38Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Creating volume cf9134e9-e715-47b5-85ed-8060118b7aab {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:41 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c568ca2e-fd64-4eff-9e42-95878115d24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c39393-d353-40b3-a9b1-7dca7f84bef6', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cf8fe7-fd80-4a9f-9e7a-8c85d7816026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:41 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab 1073741824 Jun 03 14:57:41 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:41 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume volume-70c39393-d353-40b3-a9b1-7dca7f84bef6 (70c39393-d353-40b3-a9b1-7dca7f84bef6): created successfully Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cf8fe7-fd80-4a9f-9e7a-8c85d7816026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (786d18ec-d803-40c3-aa37-4351bdc11a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:41 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-67d512fb-6c19-41e6-a6f7-a68abcba07ae tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created volume successfully. Jun 03 14:57:42 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab 1073741824" returned: 0 in 0.821s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:42 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab Jun 03 14:57:42 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:42 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab" returned: 0 in 0.630s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.818s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-99640300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be411930-e67b-4e25-8776-d4f251d4ef8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:39Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Creating volume be411930-e67b-4e25-8776-d4f251d4ef8f {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:42 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6463f4-2839-4ee0-b63f-1340089ac78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9134e9-e715-47b5-85ed-8060118b7aab', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:42 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f 1073741824 Jun 03 14:57:42 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937fed46-cc7f-4f4d-beec-fa4ad064f60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:42 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume volume-cf9134e9-e715-47b5-85ed-8060118b7aab (cf9134e9-e715-47b5-85ed-8060118b7aab): created successfully Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937fed46-cc7f-4f4d-beec-fa4ad064f60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (e94f49a5-ef68-4a79-babb-c0f83ea28dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:42 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7a1bb461-6c4d-4c4f-bba9-70fbe7a940e7 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created volume successfully. Jun 03 14:57:43 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f 1073741824" returned: 0 in 0.832s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:43 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f Jun 03 14:57:43 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:44 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f" returned: 0 in 0.666s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.905s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-947704974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981b8fb9-0804-4cbc-95ad-593ad943564c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dcf7c6f887447299ee46312260092f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:39Z,use_quota=True,user_id='5430b6a7f557493aa8562b915fb10fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Creating volume 981b8fb9-0804-4cbc-95ad-593ad943564c {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:44 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:44 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c 1073741824 Jun 03 14:57:44 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a17fda-3986-4ce0-aee0-994da966d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be411930-e67b-4e25-8776-d4f251d4ef8f', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08e49e5-ac0a-47ea-9820-62acb988fcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:44 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume volume-be411930-e67b-4e25-8776-d4f251d4ef8f (be411930-e67b-4e25-8776-d4f251d4ef8f): created successfully Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08e49e5-ac0a-47ea-9820-62acb988fcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (bc96c70d-d400-4e90-84ea-d9884e60d346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a20024be-8f25-4ac3-94d7-07a3e5f32f9d tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created volume successfully. Jun 03 14:57:45 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c 1073741824" returned: 0 in 0.946s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:45 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c Jun 03 14:57:45 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:45 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c" returned: 0 in 0.677s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52271ba-0789-4cd3-bf28-8e734df84b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981b8fb9-0804-4cbc-95ad-593ad943564c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20e3380-4ed4-4f5d-969d-9517e6f75e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:45 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Volume volume-981b8fb9-0804-4cbc-95ad-593ad943564c (981b8fb9-0804-4cbc-95ad-593ad943564c): created successfully Jun 03 14:57:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20e3380-4ed4-4f5d-969d-9517e6f75e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Flow 'volume_create_manager' (5b7e205e-5700-470e-933a-37b43012a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:45 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7b9b2daf-f5b8-49cc-af6b-8e7ce1e2fddb tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created volume successfully. Jun 03 14:57:47 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-981b8fb9-0804-4cbc-95ad-593ad943564c-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:47 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-981b8fb9-0804-4cbc-95ad-593ad943564c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:47 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-quobyte-981b8fb9-0804-4cbc-95ad-593ad943564c" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:47 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-981b8fb9-0804-4cbc-95ad-593ad943564c" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:47 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c19176-a2da-45bd-94d7-5c767a271ae4]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:47 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c Jun 03 14:57:47 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:48 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c" returned: 0 in 0.956s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:48 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c Jun 03 14:57:48 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:48 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-981b8fb9-0804-4cbc-95ad-593ad943564c" returned: 0 in 0.602s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-981b8fb9-0804-4cbc-95ad-593ad943564c" released by "delete_volume" :: held 1.613s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created reservations ['e87e3570-2d67-4a08-af36-1b72d070d9bf', '7af30aaf-a146-46ba-9fd6-33477119bc65', '12265c1f-8b76-4fda-acc5-6cbeafb0cfa1', '7c9672d7-9c93-48d6-be03-f8d763cc39b9'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:48 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:48 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-be411930-e67b-4e25-8776-d4f251d4ef8f-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-be411930-e67b-4e25-8776-d4f251d4ef8f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-quobyte-be411930-e67b-4e25-8776-d4f251d4ef8f" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-be411930-e67b-4e25-8776-d4f251d4ef8f" acquired by "delete_volume" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[60402dfb-d581-483b-a2af-84235f00abd5]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-37dd82ea-40af-45e9-a3c1-f772b50ab96b tempest-BackendsCapabilitiesAdminTestsJSON-609918518 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86614) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jun 03 14:57:49 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.684s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:49 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Deleted volume successfully. Jun 03 14:57:49 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-05b28d9f-55de-4b94-b104-c7b5ed787a46 req-b8e71697-9a2b-4182-9e09-a2a100f60b0b tempest-TestMinimumBasicScenario-1823833033 None] Terminate volume connection completed successfully. Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-05b28d9f-55de-4b94-b104-c7b5ed787a46 req-b8e71697-9a2b-4182-9e09-a2a100f60b0b tempest-TestMinimumBasicScenario-1823833033 None] Deleting attachment 6ba8daf8-b601-497e-9122-d92e7ce3dcd9. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f1263f76-91ea-4d24-b0ba-49d353c2f71e tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-981b8fb9-0804-4cbc-95ad-593ad943564c-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:49 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f Jun 03 14:57:49 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:49 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-3e8c2b41-3cdb-41c0-82d5-1980e4b4e37d tempest-BackendsCapabilitiesAdminTestsJSON-609918518 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86614) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jun 03 14:57:50 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f" returned: 0 in 0.791s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:50 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f Jun 03 14:57:50 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:50 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-be411930-e67b-4e25-8776-d4f251d4ef8f" returned: 0 in 0.607s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-be411930-e67b-4e25-8776-d4f251d4ef8f" released by "delete_volume" :: held 1.442s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created reservations ['690cb0f6-1912-4f6d-8577-a43f9d51a8a5', 'cd56f8de-786c-4f42-bcb5-3b0799958c4b', '06b8d32f-b961-43db-bd0c-3e7186e9028b', '112a643d-8360-417f-8006-4e3c76225620'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:50 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:50 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-cf9134e9-e715-47b5-85ed-8060118b7aab-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:51 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.723s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Acquiring lock "cinder-f79036cb-5258-4503-8e62-c109255bd7dc-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-cf9134e9-e715-47b5-85ed-8060118b7aab-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:51 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Deleted volume successfully. Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Lock "cinder-f79036cb-5258-4503-8e62-c109255bd7dc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-298b7e58-fcf8-48f9-b767-570410eb87d8 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-be411930-e67b-4e25-8776-d4f251d4ef8f-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-quobyte-cf9134e9-e715-47b5-85ed-8060118b7aab" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Acquiring lock "cinder-quobyte-f79036cb-5258-4503-8e62-c109255bd7dc" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-cf9134e9-e715-47b5-85ed-8060118b7aab" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Lock "cinder-quobyte-f79036cb-5258-4503-8e62-c109255bd7dc" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[97873082-9aea-4ef6-9dc8-8e7b34715cc9]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b05671-5b31-494c-9d8f-2270d1d30909]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:51 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab Jun 03 14:57:51 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:51 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc Jun 03 14:57:51 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:52 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab" returned: 0 in 0.809s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:52 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc" returned: 0 in 0.817s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:52 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab Jun 03 14:57:52 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:52 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc Jun 03 14:57:52 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:53 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-cf9134e9-e715-47b5-85ed-8060118b7aab" returned: 0 in 0.668s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-cf9134e9-e715-47b5-85ed-8060118b7aab" released by "delete_volume" :: held 1.521s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:53 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-f79036cb-5258-4503-8e62-c109255bd7dc" returned: 0 in 0.702s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Lock "cinder-quobyte-f79036cb-5258-4503-8e62-c109255bd7dc" released by "delete_volume" :: held 1.564s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created reservations ['8f35300b-f5e1-4815-a228-7198419bea0d', '4b6317f6-8583-4f87-94a8-88a80ac39ffe', '5fff14c9-d154-4e88-b7be-2f369d552e6b', 'ac64c8b6-f4fa-4e6e-9c54-ebba2de6238b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Created reservations ['ce129f1f-7cc4-42bf-b253-9ac2c8f25e70', '52823586-1200-4df9-8235-b79751faeb30', '7570efc0-a846-403d-99be-b64f4f548096', 'bf57f0db-d679-4c5c-b72a-ab83263b677b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:53 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:53 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:53 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:53 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:53 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:53 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-70c39393-d353-40b3-a9b1-7dca7f84bef6-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:53 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-70c39393-d353-40b3-a9b1-7dca7f84bef6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-quobyte-70c39393-d353-40b3-a9b1-7dca7f84bef6" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-70c39393-d353-40b3-a9b1-7dca7f84bef6" acquired by "delete_volume" :: waited 0.031s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e977f60-cd7d-449f-bc8d-00266655d655]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:54 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.848s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:54 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Deleted volume successfully. Jun 03 14:57:54 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6 Jun 03 14:57:54 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c3b2429c-0866-4ec6-94c7-312946402aa2 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-cf9134e9-e715-47b5-85ed-8060118b7aab-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:54 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.861s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:54 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Deleted volume successfully. Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-19feed79-5dc0-4475-81af-b4afca2a995a tempest-TestMinimumBasicScenario-1823833033 None] Lock "cinder-f79036cb-5258-4503-8e62-c109255bd7dc-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:54 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.915s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:57:54 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6" returned: 0 in 0.877s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:55 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6 Jun 03 14:57:55 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:55 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-70c39393-d353-40b3-a9b1-7dca7f84bef6" returned: 0 in 0.805s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-70c39393-d353-40b3-a9b1-7dca7f84bef6" released by "delete_volume" :: held 1.764s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:55 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created reservations ['eec3c847-a954-46db-85b6-bc44872cdb17', 'dda7df1e-a4e1-477a-9e49-9860a5298e8e', 'f20c37bf-0df4-4df3-8127-38cd30d12c8b', 'f7822352-dc58-44f9-b427-0c78c5454225'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:56 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:56 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-914fd79b-a710-48b2-9b6f-e7439f89da88-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-914fd79b-a710-48b2-9b6f-e7439f89da88-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8d52f2a9-d2e4-4576-9ab3-1975018fd956 tempest-GroupSnapshotsV319Test-1112208462 None] Group tempest-GroupSnapshotsV319Test-Group-1768960591: creating Jun 03 14:57:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-quobyte-914fd79b-a710-48b2-9b6f-e7439f89da88" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-914fd79b-a710-48b2-9b6f-e7439f89da88" acquired by "delete_volume" :: waited 0.028s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8d52f2a9-d2e4-4576-9ab3-1975018fd956 tempest-GroupSnapshotsV319Test-1112208462 None] Group tempest-GroupSnapshotsV319Test-Group-1768960591: created successfully Jun 03 14:57:56 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f82a249-750e-409b-ac7b-3ba20aeb8178]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8d52f2a9-d2e4-4576-9ab3-1975018fd956 tempest-GroupSnapshotsV319Test-1112208462 None] Create group completed successfully. Jun 03 14:57:56 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88 Jun 03 14:57:56 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:56 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.660s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:56 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Deleted volume successfully. Jun 03 14:57:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a63a3be8-ea9a-41a9-aa06-2f41736cd758 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-70c39393-d353-40b3-a9b1-7dca7f84bef6-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:57 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88" returned: 0 in 0.716s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:57 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88 Jun 03 14:57:57 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:57 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-914fd79b-a710-48b2-9b6f-e7439f89da88" returned: 0 in 0.643s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-914fd79b-a710-48b2-9b6f-e7439f89da88" released by "delete_volume" :: held 1.407s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created reservations ['401684fe-35e3-44a1-bd4f-5d21dbbf0b9b', 'b2e0ff01-461d-4a24-9d30-8194a96679c7', 'c03493c5-58cd-46f6-bc06-ae1a9859dbb0', '56939726-999b-449e-a6da-d23dfb3d492a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Flow 'volume_create_manager' (42f9a8d6-ecf2-4827-9c9c-dca5a5b9db82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a42880-d5a6-4348-8cbe-474209f3a914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a42880-d5a6-4348-8cbe-474209f3a914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1363684943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8c61429-d036-4ea8-8ceb-5d4315b84211,host='devstack@QuobyteHD#QuobyteHD',id=fa6303f5-3761-42fe-8b5e-3010f7d9ad4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c417ed7dbe6e48959cedad9b3ca14d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:58Z,use_quota=True,user_id='e61736382e0c488d82953386b01d7990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2515257b-8e28-4df5-bc02-5073d951b2d1),volume_type_id=2515257b-8e28-4df5-bc02-5073d951b2d1)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05543ffc-82e9-4eb0-b2ed-9fc47f22bf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05543ffc-82e9-4eb0-b2ed-9fc47f22bf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a19966-aba4-48f6-b400-6f7b83c8dce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a19966-aba4-48f6-b400-6f7b83c8dce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6303f5-3761-42fe-8b5e-3010f7d9ad4c', 'volume_name': 'volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4590e7a1-78a7-4806-8d4a-28458dde29bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4590e7a1-78a7-4806-8d4a-28458dde29bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6802932-fe1c-458c-85d0-84b0c8292fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:57 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Volume fa6303f5-3761-42fe-8b5e-3010f7d9ad4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c', 'volume_size': 1} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8c61429-d036-4ea8-8ceb-5d4315b84211,created_at=2026-06-03T12:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1363684943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8c61429-d036-4ea8-8ceb-5d4315b84211,host='devstack@QuobyteHD#QuobyteHD',id=fa6303f5-3761-42fe-8b5e-3010f7d9ad4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c417ed7dbe6e48959cedad9b3ca14d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:57:58Z,use_quota=True,user_id='e61736382e0c488d82953386b01d7990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2515257b-8e28-4df5-bc02-5073d951b2d1),volume_type_id=2515257b-8e28-4df5-bc02-5073d951b2d1)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Creating volume fa6303f5-3761-42fe-8b5e-3010f7d9ad4c {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:57:57 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:57 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c 1073741824 Jun 03 14:57:57 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:57 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:57:57 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-6137357a-443e-488f-b79b-a1168f9e20e9-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-6137357a-443e-488f-b79b-a1168f9e20e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-quobyte-e647901e-7342-41ca-a0b6-f968d93df345" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-e647901e-7342-41ca-a0b6-f968d93df345" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-quobyte-6137357a-443e-488f-b79b-a1168f9e20e9" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-6137357a-443e-488f-b79b-a1168f9e20e9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Deleting offline snapshot 6137357a-443e-488f-b79b-a1168f9e20e9 of volume e647901e-7342-41ca-a0b6-f968d93df345 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] snapshot_file for this snap is: volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[add42342-40cf-4f5f-9716-e86900c43cb6]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:58 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.668s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:57:58 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Deleted volume successfully. Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4355a5fb-9f0e-4148-92ba-d22cb6fb4b2a tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-914fd79b-a710-48b2-9b6f-e7439f89da88-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:57:58 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 Jun 03 14:57:58 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:58 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c 1073741824" returned: 0 in 0.930s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:58 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c Jun 03 14:57:58 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:59 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9" returned: 0 in 0.760s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e647901e-7342-41ca-a0b6-f968d93df345(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dd9647-0074-4d62-8308-f9a885bfeeab]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:57:59 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 Jun 03 14:57:59 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:57:59 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" returned: 0 in 0.649s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6802932-fe1c-458c-85d0-84b0c8292fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75dd9960-b915-4cac-8adf-83160a0c409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:57:59 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Volume volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c (fa6303f5-3761-42fe-8b5e-3010f7d9ad4c): created successfully Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75dd9960-b915-4cac-8adf-83160a0c409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:57:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Flow 'volume_create_manager' (42f9a8d6-ecf2-4827-9c9c-dca5a5b9db82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:57:59 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-453ced57-f89a-4fa1-b33b-87a0e49c3075 tempest-GroupSnapshotsV319Test-1112208462 None] Created volume successfully. Jun 03 14:58:00 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345" returned: 0 in 0.744s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:00 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 Jun 03 14:58:00 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:00 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] GroupSnapshot 1025b3ce-dfe9-468a-9fa3-07d04b2f7890: creating. Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Group snapshot 1025b3ce-dfe9-468a-9fa3-07d04b2f7890: creating. {{(pid=86614) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Creating offline snapshot a08fac92-203d-4558-b318-ed82c7b709d0 of volume fa6303f5-3761-42fe-8b5e-3010f7d9ad4c {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c01c470-0bd4-4bfc-8eed-1cc427f44223]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:00 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c Jun 03 14:58:00 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:00 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9" returned: 0 in 0.706s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:00 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9 Jun 03 14:58:00 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:00 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" returned: 0 in 0.778s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:01 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 1G Jun 03 14:58:01 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:01 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345.6137357a-443e-488f-b79b-a1168f9e20e9" returned: 0 in 0.670s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-6137357a-443e-488f-b79b-a1168f9e20e9" released by "_delete_snapshot" :: held 3.023s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-e647901e-7342-41ca-a0b6-f968d93df345" released by "delete_snapshot" :: held 3.052s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:01 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created reservations ['fa4f06f2-a251-44d0-b9be-c297c7a9a19c', '3a51e4a4-2e37-4aef-b659-ebc62eac4162', 'dfee8945-40af-4198-bd03-790c0dcd262b', 'da00791c-37a9-4d42-92c2-d75078f33062'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:01 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Delete snapshot completed successfully. Jun 03 14:58:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-617f53a2-88c7-4cdc-8dbe-61e342aa4318 tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-6137357a-443e-488f-b79b-a1168f9e20e9-delete_snapshot" released by "delete_snapshot" :: held 3.297s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:01 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 1G" returned: 0 in 0.918s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:01 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 Jun 03 14:58:01 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:02 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0" returned: 0 in 0.683s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:02 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:58:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:02 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 Jun 03 14:58:02 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-e647901e-7342-41ca-a0b6-f968d93df345-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-e647901e-7342-41ca-a0b6-f968d93df345-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "cinder-quobyte-e647901e-7342-41ca-a0b6-f968d93df345" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-e647901e-7342-41ca-a0b6-f968d93df345" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:02 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[f578d892-c7ec-4d87-a872-e0c89c2bc321]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:02 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 Jun 03 14:58:02 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:03 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0" returned: 0 in 0.649s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:03 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.info Jun 03 14:58:03 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:03 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345" returned: 0 in 0.762s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:03 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345 Jun 03 14:58:03 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:04 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.info" returned: 0 in 0.756s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:04 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:04 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.info Jun 03 14:58:04 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:04 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e647901e-7342-41ca-a0b6-f968d93df345" returned: 0 in 0.713s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-quobyte-e647901e-7342-41ca-a0b6-f968d93df345" released by "delete_volume" :: held 1.547s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Created reservations ['22901370-2685-4c32-b4d8-a46937be195c', 'a8dfbb80-d440-4d30-9d36-51953372aec8', '099c2639-e93f-4e43-ba09-e6b3fa6b94f8', '41cfa6fa-8ad5-4de4-97ae-79111bc04dbb'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:04 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:58:04 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:04 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.info" returned: 0 in 0.698s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.579s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:04 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4776d039-4e20-44b3-8c34-75d7d83d5d9a tempest-GroupSnapshotsV319Test-1112208462 None] group_snapshot 1025b3ce-dfe9-468a-9fa3-07d04b2f7890: created successfully Jun 03 14:58:05 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.642s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:05 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:58:05 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Deleted volume successfully. Jun 03 14:58:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fcd81ce4-173c-4b3a-8fe3-ea395bb579fa tempest-CreateVolumesFromSnapshotTest-1655924953 None] Lock "cinder-e647901e-7342-41ca-a0b6-f968d93df345-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:05 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] group_snapshot 1025b3ce-dfe9-468a-9fa3-07d04b2f7890: deleting Jun 03 14:58:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] group_snapshot 1025b3ce-dfe9-468a-9fa3-07d04b2f7890: deleting {{(pid=86614) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 03 14:58:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Acquiring lock "cinder-quobyte-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "cinder-quobyte-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Acquiring lock "cinder-quobyte-a08fac92-203d-4558-b318-ed82c7b709d0" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "cinder-quobyte-a08fac92-203d-4558-b318-ed82c7b709d0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Deleting offline snapshot a08fac92-203d-4558-b318-ed82c7b709d0 of volume fa6303f5-3761-42fe-8b5e-3010f7d9ad4c {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] snapshot_file for this snap is: volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a39ca38-8cc6-452d-b699-490c6567512f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:06 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 Jun 03 14:58:06 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:06 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0" returned: 0 in 0.823s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6518b5-b768-4d9d-ad41-defa6e5d6ded]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:07 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c Jun 03 14:58:07 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:07 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" returned: 0 in 0.787s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:07 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 Jun 03 14:58:07 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:08 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0" returned: 0 in 0.863s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:08 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0 Jun 03 14:58:08 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:09 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c.a08fac92-203d-4558-b318-ed82c7b709d0" returned: 0 in 0.674s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "cinder-quobyte-a08fac92-203d-4558-b318-ed82c7b709d0" released by "_delete_snapshot" :: held 3.277s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "cinder-quobyte-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" released by "delete_snapshot" :: held 3.308s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:09 devstack cinder-volume[86614]: WARNING cinder.quota [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1996061499 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1996061499, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:58:09 devstack cinder-volume[86614]: WARNING cinder.quota [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1996061499 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1996061499, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:58:09 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] Created reservations ['69cbde63-98b0-4971-be86-8093e64b70ad', 'c3f5f72e-b064-4732-9b7e-b2c4d4b2f34b', '0c8c661b-f32a-4844-a9a4-a94162f262ed', 'c760c24b-f04b-4183-85ec-eb41b047bd8e'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:09 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ab6a76a0-f5f8-4e81-9b44-466ce5fed7b5 tempest-GroupSnapshotsV319Test-1112208462 None] group_snapshot 1025b3ce-dfe9-468a-9fa3-07d04b2f7890: deleted successfully Jun 03 14:58:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Acquiring lock "cinder-quobyte-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "cinder-quobyte-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" acquired by "delete_volume" :: waited 0.032s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:10 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[26accc4c-6753-450e-a0c5-76e4be0a2873]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:10 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c Jun 03 14:58:10 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:11 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" returned: 0 in 0.813s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:11 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c Jun 03 14:58:11 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:12 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" returned: 0 in 0.625s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "cinder-quobyte-fa6303f5-3761-42fe-8b5e-3010f7d9ad4c" released by "delete_volume" :: held 1.539s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:12 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Created reservations ['d29cda2b-1f67-4c37-a354-9fe2c4745e51'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:12 devstack cinder-volume[86614]: WARNING cinder.quota [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1996061499 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1996061499, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:58:12 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Created reservations ['6727eabc-fe5a-47e9-a48f-b3ee4bdbfb2d', '575596f3-8b0d-4572-844c-7d9575702914', '8ee0d49a-8b7f-41d7-9d6e-54227aa83db3', '12b2cf04-fb62-423a-9068-70fa39a26358'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:12 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:58:12 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:13 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.776s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:13 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:58:13 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1c045926-15b9-4f92-98ae-c766143bf593 tempest-GroupSnapshotsV319Test-1112208462 None] Delete group completed successfully. Jun 03 14:58:21 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=176,cinder:SELECT=131,cinder:INSERT=46,cinder:DELETE=14 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:58:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-54176fec-6f6e-4b6e-87a2-29fa26235e50 tempest-GroupsTest-549557608 None] Group tempest-Group1-910641442: creating Jun 03 14:58:21 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=165,cinder:DELETE=10,cinder:SELECT=121,cinder:INSERT=37 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:58:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-54176fec-6f6e-4b6e-87a2-29fa26235e50 tempest-GroupsTest-549557608 None] Group tempest-Group1-910641442: created successfully Jun 03 14:58:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-54176fec-6f6e-4b6e-87a2-29fa26235e50 tempest-GroupsTest-549557608 None] Create group completed successfully. Jun 03 14:58:23 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f4b428d7-2d85-4a6c-a12e-27a471bd3dd1 tempest-GroupsTest-549557608 None] Group tempest-Group2-2023480200: creating Jun 03 14:58:23 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f4b428d7-2d85-4a6c-a12e-27a471bd3dd1 tempest-GroupsTest-549557608 None] Group tempest-Group2-2023480200: created successfully Jun 03 14:58:23 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f4b428d7-2d85-4a6c-a12e-27a471bd3dd1 tempest-GroupsTest-549557608 None] Create group completed successfully. Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Flow 'volume_create_manager' (0a32ca48-bc34-4112-ba2a-d40d047235c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a29288-3e36-402e-b246-778c47dc93d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a29288-3e36-402e-b246-778c47dc93d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-101865160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e23a1d58-a15c-4828-91c5-877604e6e329,host='devstack@QuobyteHD#QuobyteHD',id=0911a1ac-c450-4709-a0c4-31b697d8d41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a108ffc91ea843e5b46ad32046d3e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:58:25Z,use_quota=True,user_id='1ae92f4c681f41f585e14b6200cea3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7be45374-759c-4313-a5e3-bba0e5bae64d),volume_type_id=7be45374-759c-4313-a5e3-bba0e5bae64d)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0f46be-227e-4e2b-a905-e0f570066b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0f46be-227e-4e2b-a905-e0f570066b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923e6b87-b935-4084-880e-fc4472a1b3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923e6b87-b935-4084-880e-fc4472a1b3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0911a1ac-c450-4709-a0c4-31b697d8d41b', 'volume_name': 'volume-0911a1ac-c450-4709-a0c4-31b697d8d41b', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9bcf4c-b1fa-45a6-9ac4-cb091697e8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9bcf4c-b1fa-45a6-9ac4-cb091697e8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ec275f-7bc7-4e80-ac41-177707f7275e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:24 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Volume 0911a1ac-c450-4709-a0c4-31b697d8d41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0911a1ac-c450-4709-a0c4-31b697d8d41b', 'volume_size': 1} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e23a1d58-a15c-4828-91c5-877604e6e329,created_at=2026-06-03T12:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-101865160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e23a1d58-a15c-4828-91c5-877604e6e329,host='devstack@QuobyteHD#QuobyteHD',id=0911a1ac-c450-4709-a0c4-31b697d8d41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a108ffc91ea843e5b46ad32046d3e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:58:25Z,use_quota=True,user_id='1ae92f4c681f41f585e14b6200cea3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7be45374-759c-4313-a5e3-bba0e5bae64d),volume_type_id=7be45374-759c-4313-a5e3-bba0e5bae64d)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Creating volume 0911a1ac-c450-4709-a0c4-31b697d8d41b {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:58:24 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:58:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:24 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b 1073741824 Jun 03 14:58:24 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:25 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b 1073741824" returned: 0 in 0.991s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:25 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b Jun 03 14:58:25 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:26 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b" returned: 0 in 0.704s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:58:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ec275f-7bc7-4e80-ac41-177707f7275e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0911a1ac-c450-4709-a0c4-31b697d8d41b', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc290064-2d28-43c8-af26-1a609704131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:26 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Volume volume-0911a1ac-c450-4709-a0c4-31b697d8d41b (0911a1ac-c450-4709-a0c4-31b697d8d41b): created successfully Jun 03 14:58:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc290064-2d28-43c8-af26-1a609704131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Flow 'volume_create_manager' (0a32ca48-bc34-4112-ba2a-d40d047235c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:58:26 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e7a76b2f-2c40-470e-ad68-42cf042fc16a tempest-GroupsTest-549557608 None] Created volume successfully. Jun 03 14:58:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Acquiring lock "cinder-quobyte-0911a1ac-c450-4709-a0c4-31b697d8d41b" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Lock "cinder-quobyte-0911a1ac-c450-4709-a0c4-31b697d8d41b" acquired by "delete_volume" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:27 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8751ae3a-edce-413d-a66d-0031680f9b01]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:27 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b Jun 03 14:58:27 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:28 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b" returned: 0 in 0.758s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:28 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b Jun 03 14:58:28 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:28 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0911a1ac-c450-4709-a0c4-31b697d8d41b" returned: 0 in 0.675s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Lock "cinder-quobyte-0911a1ac-c450-4709-a0c4-31b697d8d41b" released by "delete_volume" :: held 1.511s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Created reservations ['09162122-4083-491d-acd7-d80af0d3faa1'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:29 devstack cinder-volume[86614]: WARNING cinder.quota [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2035913981 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2035913981, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:58:29 devstack cinder-volume[86614]: WARNING cinder.quota [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2035913981 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2035913981, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Created reservations ['4851ced1-6f13-4aff-86df-4b9757b86ba5', '0d8a1773-73f3-4fa9-9ef6-faf3730a18a5', '3fed2c87-a63c-4cc0-a7bd-741202846aa7', '37072217-7c07-448f-a464-82d7daf3a011'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:29 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:58:29 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-dba2e3a4-d3ca-4505-84be-d7ea5869b0f1 tempest-GroupsTest-549557608 None] Created reservations ['d1b67947-ae9e-47c3-aa56-d9933b218a8b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:29 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.708s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:29 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:58:30 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-3d5fbc2b-59d8-486f-9923-f1536e647f39 tempest-GroupsTest-549557608 None] Delete group completed successfully. Jun 03 14:58:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dba2e3a4-d3ca-4505-84be-d7ea5869b0f1 tempest-GroupsTest-549557608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dba2e3a4-d3ca-4505-84be-d7ea5869b0f1 tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-dba2e3a4-d3ca-4505-84be-d7ea5869b0f1 tempest-GroupsTest-549557608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-dba2e3a4-d3ca-4505-84be-d7ea5869b0f1 tempest-GroupsTest-549557608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-dba2e3a4-d3ca-4505-84be-d7ea5869b0f1 tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dba2e3a4-d3ca-4505-84be-d7ea5869b0f1 tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:30 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:58:30 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:30 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dba2e3a4-d3ca-4505-84be-d7ea5869b0f1 tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.636s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:30 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-dba2e3a4-d3ca-4505-84be-d7ea5869b0f1 tempest-GroupsTest-549557608 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:58:30 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-dba2e3a4-d3ca-4505-84be-d7ea5869b0f1 tempest-GroupsTest-549557608 None] Delete group completed successfully. Jun 03 14:58:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-184deddc-b9a3-426c-a5f6-fa98a88bde93 tempest-GroupsTest-549557608 None] Group tempest-GroupsTest-Group-88757401: creating Jun 03 14:58:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-184deddc-b9a3-426c-a5f6-fa98a88bde93 tempest-GroupsTest-549557608 None] Group tempest-GroupsTest-Group-88757401: created successfully Jun 03 14:58:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-184deddc-b9a3-426c-a5f6-fa98a88bde93 tempest-GroupsTest-549557608 None] Create group completed successfully. Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Flow 'volume_create_manager' (9808e6dc-6f2e-4536-8f51-9683a0bf1cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2da208f-3af3-4131-a6ea-1546f5bc4e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2da208f-3af3-4131-a6ea-1546f5bc4e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-395327042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3853709-4252-4c15-8e78-46a57cf8b6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb0f24d510b4e489e849ac7ea1ea497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:58:32Z,use_quota=True,user_id='0c8587919f25435fbfddb9863b5cf833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4271c42-f45f-49f6-9fb3-127aedd656c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4271c42-f45f-49f6-9fb3-127aedd656c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ea4b58-e26c-41b1-87a1-8af722bf3356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ea4b58-e26c-41b1-87a1-8af722bf3356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3853709-4252-4c15-8e78-46a57cf8b6e8', 'volume_name': 'volume-d3853709-4252-4c15-8e78-46a57cf8b6e8', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe070fd-819d-462a-ae72-c30ced867d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe070fd-819d-462a-ae72-c30ced867d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b66d44-01f5-4547-a1ef-80c46038d3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:32 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Volume d3853709-4252-4c15-8e78-46a57cf8b6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3853709-4252-4c15-8e78-46a57cf8b6e8', 'volume_size': 1} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-395327042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3853709-4252-4c15-8e78-46a57cf8b6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb0f24d510b4e489e849ac7ea1ea497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:58:32Z,use_quota=True,user_id='0c8587919f25435fbfddb9863b5cf833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Creating volume d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:58:32 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:58:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:32 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 1073741824 Jun 03 14:58:32 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Flow 'volume_create_manager' (ce95fff6-5324-4da5-be92-eaf9edfdd868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e33ca7-19ea-45bd-8809-fcb6fdf1798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e33ca7-19ea-45bd-8809-fcb6fdf1798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-641723060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bc43cce-19d5-4974-b92c-a1b2022f0bf7,host='devstack@QuobyteHD#QuobyteHD',id=ee042383-3530-47c1-97d2-0199f651a581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a108ffc91ea843e5b46ad32046d3e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:58:33Z,use_quota=True,user_id='1ae92f4c681f41f585e14b6200cea3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64abb1a9-75ba-4355-8edd-d96807c061e4),volume_type_id=64abb1a9-75ba-4355-8edd-d96807c061e4)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1f6a10-3476-4b29-bd7a-df07a9267a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1f6a10-3476-4b29-bd7a-df07a9267a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:33 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209c2666-d8b0-4ded-a6ed-716c4756c320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209c2666-d8b0-4ded-a6ed-716c4756c320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee042383-3530-47c1-97d2-0199f651a581', 'volume_name': 'volume-ee042383-3530-47c1-97d2-0199f651a581', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4236cb-2cf3-4d95-95f4-8c16c28cc2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4236cb-2cf3-4d95-95f4-8c16c28cc2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d509db-4fb6-4261-90c3-8b668249a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:33 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Volume ee042383-3530-47c1-97d2-0199f651a581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee042383-3530-47c1-97d2-0199f651a581', 'volume_size': 1} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 1073741824" returned: 0 in 1.124s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:33 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 Jun 03 14:58:33 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:34 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8" returned: 0 in 0.604s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5bc43cce-19d5-4974-b92c-a1b2022f0bf7,created_at=2026-06-03T12:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-641723060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bc43cce-19d5-4974-b92c-a1b2022f0bf7,host='devstack@QuobyteHD#QuobyteHD',id=ee042383-3530-47c1-97d2-0199f651a581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a108ffc91ea843e5b46ad32046d3e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:58:33Z,use_quota=True,user_id='1ae92f4c681f41f585e14b6200cea3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64abb1a9-75ba-4355-8edd-d96807c061e4),volume_type_id=64abb1a9-75ba-4355-8edd-d96807c061e4)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Creating volume ee042383-3530-47c1-97d2-0199f651a581 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:58:34 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b66d44-01f5-4547-a1ef-80c46038d3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3853709-4252-4c15-8e78-46a57cf8b6e8', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:34 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581 1073741824 Jun 03 14:58:34 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b75e78c-0856-475f-9da2-31ed9ba1c244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:34 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Volume volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 (d3853709-4252-4c15-8e78-46a57cf8b6e8): created successfully Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b75e78c-0856-475f-9da2-31ed9ba1c244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Flow 'volume_create_manager' (9808e6dc-6f2e-4536-8f51-9683a0bf1cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:58:34 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-cc981d4e-9d90-4f96-9fad-49a4bbc75f9a tempest-SnapshotDependencyTests-2055539547 None] Created volume successfully. Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:34 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581 1073741824" returned: 0 in 0.850s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:35 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581 Jun 03 14:58:35 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:35 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581" returned: 0 in 0.607s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.893s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d509db-4fb6-4261-90c3-8b668249a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee042383-3530-47c1-97d2-0199f651a581', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de2e268-b979-438f-9bc8-86eb672c259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Creating offline snapshot c740dc6e-46dc-47ad-a873-d83aa8f430e3 of volume d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 14:58:35 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Volume volume-ee042383-3530-47c1-97d2-0199f651a581 (ee042383-3530-47c1-97d2-0199f651a581): created successfully Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de2e268-b979-438f-9bc8-86eb672c259e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Flow 'volume_create_manager' (ce95fff6-5324-4da5-be92-eaf9edfdd868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8022e4e2-ac3f-45ce-a038-11841dc27223]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:35 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f73a5859-9768-4172-993a-2508225e773b tempest-GroupsTest-549557608 None] Created volume successfully. Jun 03 14:58:35 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 Jun 03 14:58:35 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:36 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8" returned: 0 in 0.745s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:36 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 1G Jun 03 14:58:36 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Flow 'volume_create_manager' (35ce2504-572e-4572-9057-10752b210aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0906b622-6182-4d0c-9cdb-6deec6fbde66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0906b622-6182-4d0c-9cdb-6deec6fbde66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1150431286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bc43cce-19d5-4974-b92c-a1b2022f0bf7,host='devstack@QuobyteHD#QuobyteHD',id=a34fd265-0508-4396-8bb8-079510f28d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a108ffc91ea843e5b46ad32046d3e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:58:37Z,use_quota=True,user_id='1ae92f4c681f41f585e14b6200cea3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64abb1a9-75ba-4355-8edd-d96807c061e4),volume_type_id=64abb1a9-75ba-4355-8edd-d96807c061e4)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d832d8ca-223d-4cb2-bb3c-54ed14b23c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d832d8ca-223d-4cb2-bb3c-54ed14b23c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dbe57f-aa80-400d-b183-b86bc77b72ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dbe57f-aa80-400d-b183-b86bc77b72ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34fd265-0508-4396-8bb8-079510f28d59', 'volume_name': 'volume-a34fd265-0508-4396-8bb8-079510f28d59', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0073d8-9668-481e-9fb3-cbc676104820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0073d8-9668-481e-9fb3-cbc676104820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e1a7db9-d5fe-4e20-851b-50c72dcccde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:37 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Volume a34fd265-0508-4396-8bb8-079510f28d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34fd265-0508-4396-8bb8-079510f28d59', 'volume_size': 1} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:37 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 1G" returned: 0 in 0.849s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:37 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 Jun 03 14:58:37 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:38 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3" returned: 0 in 0.750s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:38 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 is being set with open permissions: ugo+rw Jun 03 14:58:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:38 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 Jun 03 14:58:38 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:38 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3" returned: 0 in 0.606s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:38 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.info Jun 03 14:58:38 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:39 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.info" returned: 0 in 0.630s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:39 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.info is being set with open permissions: ugo+rw Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:39 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.info Jun 03 14:58:39 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:39 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.info" returned: 0 in 0.622s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.346s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5bc43cce-19d5-4974-b92c-a1b2022f0bf7,created_at=2026-06-03T12:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1150431286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bc43cce-19d5-4974-b92c-a1b2022f0bf7,host='devstack@QuobyteHD#QuobyteHD',id=a34fd265-0508-4396-8bb8-079510f28d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a108ffc91ea843e5b46ad32046d3e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:58:37Z,use_quota=True,user_id='1ae92f4c681f41f585e14b6200cea3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64abb1a9-75ba-4355-8edd-d96807c061e4),volume_type_id=64abb1a9-75ba-4355-8edd-d96807c061e4)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Creating volume a34fd265-0508-4396-8bb8-079510f28d59 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:40 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:58:40 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:58:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:40 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59 1073741824 Jun 03 14:58:40 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:40 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ef2f35c2-e2b6-4756-976a-f3911bd3eb04 tempest-SnapshotDependencyTests-2055539547 None] Create snapshot completed successfully Jun 03 14:58:40 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59 1073741824" returned: 0 in 0.799s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:40 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59 Jun 03 14:58:40 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:41 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59" returned: 0 in 0.629s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e1a7db9-d5fe-4e20-851b-50c72dcccde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34fd265-0508-4396-8bb8-079510f28d59', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87aa450-217c-4d54-8d5e-c7c622781e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:41 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Volume volume-a34fd265-0508-4396-8bb8-079510f28d59 (a34fd265-0508-4396-8bb8-079510f28d59): created successfully Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87aa450-217c-4d54-8d5e-c7c622781e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Flow 'volume_create_manager' (35ce2504-572e-4572-9057-10752b210aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:58:41 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-efdba0ea-1566-488d-8ae1-a7fb402318b7 tempest-GroupsTest-549557608 None] Created volume successfully. Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Flow 'volume_create_manager' (a64f425a-b792-499a-afa5-9e2a5e21f367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d9469f-8742-4872-805c-8cf0deff491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d9469f-8742-4872-805c-8cf0deff491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a562a4-1f3b-4fff-a020-14dfa26d6af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb0f24d510b4e489e849ac7ea1ea497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c740dc6e-46dc-47ad-a873-d83aa8f430e3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:58:42Z,use_quota=True,user_id='0c8587919f25435fbfddb9863b5cf833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc8903f-be47-4bf6-b5b5-559498808d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc8903f-be47-4bf6-b5b5-559498808d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71deff30-1fce-408d-9a11-fb14188aa0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71deff30-1fce-408d-9a11-fb14188aa0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c1a562a4-1f3b-4fff-a020-14dfa26d6af9', 'volume_name': 'volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9', 'volume_size': 1, 'snapshot_id': 'c740dc6e-46dc-47ad-a873-d83aa8f430e3'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e793b3d-f411-48fd-8241-f75b2d09237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e793b3d-f411-48fd-8241-f75b2d09237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8af062-9f76-4c52-a238-caa3d6d72059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:41 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Volume c1a562a4-1f3b-4fff-a020-14dfa26d6af9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9', 'volume_size': 1, 'snapshot_id': 'c740dc6e-46dc-47ad-a873-d83aa8f430e3'} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "cinder-quobyte-c740dc6e-46dc-47ad-a873-d83aa8f430e3-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" by "_create_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-c740dc6e-46dc-47ad-a873-d83aa8f430e3-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Creating volume c1a562a4-1f3b-4fff-a020-14dfa26d6af9 from snapshot c740dc6e-46dc-47ad-a873-d83aa8f430e3 {{(pid=86614) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "cinder-quobyte-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] snapshot: c740dc6e-46dc-47ad-a873-d83aa8f430e3, volume: c1a562a4-1f3b-4fff-a020-14dfa26d6af9, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e52a4b2-03bb-41df-ad07-0ec3f9fc047f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:41 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 Jun 03 14:58:41 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:42 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3" returned: 0 in 0.722s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3853709-4252-4c15-8e78-46a57cf8b6e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:58:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 14:58:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 14:58:42 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ca3565-71c6-412e-aecf-59342e7f0167]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:42 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 Jun 03 14:58:42 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:42 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e7fb1349-8204-4e63-8859-d900d5daaf4d tempest-GroupsTest-549557608 None] Update group completed successfully. Jun 03 14:58:43 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8" returned: 0 in 0.756s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:43 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 14:58:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:43 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 Jun 03 14:58:43 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8d334b68-1b3b-4e51-a731-0e6f4f04171f tempest-GroupsTest-549557608 None] Update group completed successfully. Jun 03 14:58:46 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Acquiring lock "cinder-quobyte-a34fd265-0508-4396-8bb8-079510f28d59" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:46 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Lock "cinder-quobyte-a34fd265-0508-4396-8bb8-079510f28d59" acquired by "delete_volume" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:46 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[995eb557-6937-422f-8ee0-875fce45a0ed]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:46 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59 Jun 03 14:58:46 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:47 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59" returned: 0 in 1.513s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:47 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59 Jun 03 14:58:47 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:49 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" returned: 0 in 5.857s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:49 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf49679-2895-492a-8c43-fd7ef72f9e86]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:49 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 Jun 03 14:58:49 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:49 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a34fd265-0508-4396-8bb8-079510f28d59" returned: 0 in 1.731s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:49 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Lock "cinder-quobyte-a34fd265-0508-4396-8bb8-079510f28d59" released by "delete_volume" :: held 3.344s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:49 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Acquiring lock "cinder-quobyte-ee042383-3530-47c1-97d2-0199f651a581" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:49 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Lock "cinder-quobyte-ee042383-3530-47c1-97d2-0199f651a581" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:49 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[2529c92d-5ba4-4bc7-ba78-38d9cdddf106]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:49 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581 Jun 03 14:58:49 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:50 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8" returned: 0 in 0.955s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:58:50 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Converted 1024.00 MB image at 174.79 MB/s Jun 03 14:58:50 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 is being set with open permissions: ugo+rw Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:50 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 Jun 03 14:58:50 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:50 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581" returned: 0 in 0.765s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:50 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581 Jun 03 14:58:50 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:50 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" returned: 0 in 0.617s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" released by "_copy_volume_from_snapshot" :: held 9.017s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-c740dc6e-46dc-47ad-a873-d83aa8f430e3-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" released by "_create_volume_from_snapshot" :: held 9.054s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.071s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:50 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ee042383-3530-47c1-97d2-0199f651a581" returned: 0 in 0.624s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Lock "cinder-quobyte-ee042383-3530-47c1-97d2-0199f651a581" released by "delete_volume" :: held 1.431s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8af062-9f76-4c52-a238-caa3d6d72059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9', 'volume_size': 1, 'snapshot_id': 'c740dc6e-46dc-47ad-a873-d83aa8f430e3'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117a7416-bc31-4951-ab81-1763a24122a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:58:50 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Volume volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 (c1a562a4-1f3b-4fff-a020-14dfa26d6af9): created successfully Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117a7416-bc31-4951-ab81-1763a24122a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Flow 'volume_create_manager' (a64f425a-b792-499a-afa5-9e2a5e21f367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:58:50 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4bb2ccc9-8000-485b-a825-d87d49629173 tempest-SnapshotDependencyTests-2055539547 None] Created volume successfully. Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Created reservations ['f23eaf58-9240-4400-b837-15e092028039'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:50 devstack cinder-volume[86614]: WARNING cinder.quota [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1858381817 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1858381817, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:58:50 devstack cinder-volume[86614]: WARNING cinder.quota [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1858381817 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1858381817, it is now deprecated. Please use the default quota class for default quota. Jun 03 14:58:50 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Created reservations ['e097ed37-5a3f-4a37-8679-bcca89cb6fcd', '0b065251-dbe0-43e5-ad77-32145166460a', '83bdae46-7698-4837-a87e-0fe53d9a52f7', '47aebe08-adb4-4eb6-8d4b-111bfe9d3cc9'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Created reservations ['a12716be-986c-4dde-b7b6-2832afedb49a', '7e4c5442-38cc-47a6-b987-9dc5f20ddb68', 'e69edf8a-1f66-4001-a51e-00e3c0bc386f', 'de9e998a-67f1-4e3f-9356-465fd2ed78fd'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:51 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:58:51 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "cinder-c740dc6e-46dc-47ad-a873-d83aa8f430e3-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-c740dc6e-46dc-47ad-a873-d83aa8f430e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "cinder-quobyte-d3853709-4252-4c15-8e78-46a57cf8b6e8" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-d3853709-4252-4c15-8e78-46a57cf8b6e8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "cinder-quobyte-c740dc6e-46dc-47ad-a873-d83aa8f430e3" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-c740dc6e-46dc-47ad-a873-d83aa8f430e3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Deleting offline snapshot c740dc6e-46dc-47ad-a873-d83aa8f430e3 of volume d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] snapshot_file for this snap is: volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f68bc5-2b86-4dc5-b9c3-e03ae380d6a0]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:51 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.624s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:51 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:58:51 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b5b7cf7d-5da4-4709-a8a9-d334d39255c1 tempest-GroupsTest-549557608 None] Delete group completed successfully. Jun 03 14:58:51 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 Jun 03 14:58:51 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:52 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3" returned: 0 in 0.754s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3853709-4252-4c15-8e78-46a57cf8b6e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 14:58:52 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f480ea-4128-4350-bbba-dcfe313f7cc2]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:52 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 Jun 03 14:58:52 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8" returned: 0 in 0.781s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:53 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:53 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 Jun 03 14:58:53 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:58:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:53 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:58:53 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:54 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3" returned: 0 in 0.755s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:54 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3 Jun 03 14:58:54 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:54 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.715s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:58:54 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8.c740dc6e-46dc-47ad-a873-d83aa8f430e3" returned: 0 in 0.669s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-c740dc6e-46dc-47ad-a873-d83aa8f430e3" released by "_delete_snapshot" :: held 3.063s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-d3853709-4252-4c15-8e78-46a57cf8b6e8" released by "delete_snapshot" :: held 3.088s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Created reservations ['7c282758-b49a-4ef6-8e2f-f06afc4581c7', '035ddd8d-8aae-43eb-9fd8-c4f27f39257a', '7e0d86a4-eb5f-457a-a6f4-5f6d1b8850ba', 'faf31199-81c7-4087-a695-6046b219250e'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:54 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Delete snapshot completed successfully. Jun 03 14:58:54 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c4c65594-f18f-445d-81a3-96070302cc6e tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-c740dc6e-46dc-47ad-a873-d83aa8f430e3-delete_snapshot" released by "delete_snapshot" :: held 3.243s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "cinder-d3853709-4252-4c15-8e78-46a57cf8b6e8-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-d3853709-4252-4c15-8e78-46a57cf8b6e8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "cinder-quobyte-d3853709-4252-4c15-8e78-46a57cf8b6e8" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-d3853709-4252-4c15-8e78-46a57cf8b6e8" acquired by "delete_volume" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:56 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f661bf-c7b4-41f6-8274-fb8b3dd504b7]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:56 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 Jun 03 14:58:56 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:56 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8" returned: 0 in 0.803s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:56 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8 Jun 03 14:58:56 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:57 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d43f6631-335f-44ae-915f-0c56ff64b658 tempest-GroupsV320Test-812324850 None] Group tempest-GroupsV320Test-Group-1740786229: creating Jun 03 14:58:57 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d43f6631-335f-44ae-915f-0c56ff64b658 tempest-GroupsV320Test-812324850 None] Group tempest-GroupsV320Test-Group-1740786229: created successfully Jun 03 14:58:57 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d43f6631-335f-44ae-915f-0c56ff64b658 tempest-GroupsV320Test-812324850 None] Create group completed successfully. Jun 03 14:58:57 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3853709-4252-4c15-8e78-46a57cf8b6e8" returned: 0 in 0.736s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-d3853709-4252-4c15-8e78-46a57cf8b6e8" released by "delete_volume" :: held 1.620s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:57 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Created reservations ['0effaf54-5605-4ec2-8a45-8a61b67d96ec', 'a5e06de1-1ca0-45f9-933a-550f2b423c3d', '9c01bbb6-963b-49e6-9a12-d5a534960a5a', '5e772d38-34a5-43e5-8559-ab1904ec9578'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:57 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:58:57 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "cinder-c1a562a4-1f3b-4fff-a020-14dfa26d6af9-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-c1a562a4-1f3b-4fff-a020-14dfa26d6af9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "cinder-quobyte-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:58:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" acquired by "delete_volume" :: waited 0.032s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:58:58 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.686s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:58 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:58:58 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Deleted volume successfully. Jun 03 14:58:58 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[c979fc04-119a-4ed2-bd05-a77a9e23791e]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:58:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7d15782c-007f-4414-b576-4c9f7470a57e tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-d3853709-4252-4c15-8e78-46a57cf8b6e8-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:58:58 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 Jun 03 14:58:58 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:59 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-45fa3475-0e62-423b-8c83-a1ec409392c8 tempest-GroupsV320Test-812324850 None] Created reservations ['3373bd7f-c848-44a5-9017-6506b2ac1169'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:58:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-45fa3475-0e62-423b-8c83-a1ec409392c8 tempest-GroupsV320Test-812324850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:58:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-45fa3475-0e62-423b-8c83-a1ec409392c8 tempest-GroupsV320Test-812324850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:58:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-45fa3475-0e62-423b-8c83-a1ec409392c8 tempest-GroupsV320Test-812324850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:58:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-45fa3475-0e62-423b-8c83-a1ec409392c8 tempest-GroupsV320Test-812324850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:58:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-45fa3475-0e62-423b-8c83-a1ec409392c8 tempest-GroupsV320Test-812324850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:58:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-45fa3475-0e62-423b-8c83-a1ec409392c8 tempest-GroupsV320Test-812324850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:59 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:58:59 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:58:59 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jun 03 14:58:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" returned: 0 in 1.135s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:58:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:58:59 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9 Jun 03 14:58:59 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:00 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-45fa3475-0e62-423b-8c83-a1ec409392c8 tempest-GroupsV320Test-812324850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.792s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-45fa3475-0e62-423b-8c83-a1ec409392c8 tempest-GroupsV320Test-812324850 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:59:00 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-45fa3475-0e62-423b-8c83-a1ec409392c8 tempest-GroupsV320Test-812324850 None] Delete group completed successfully. Jun 03 14:59:00 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" returned: 0 in 0.646s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-quobyte-c1a562a4-1f3b-4fff-a020-14dfa26d6af9" released by "delete_volume" :: held 1.861s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Created reservations ['698adf4a-b500-4fd3-8ac6-b4a505e539cc', '2b976a55-49ba-421d-82a4-d2f0f135695c', 'a158382c-381e-4b31-8fb3-d02df0584b75', 'd24b9675-2bf3-4869-8817-5803a5c087ab'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:00 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:59:00 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:01 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.904s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:01 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:59:01 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Deleted volume successfully. Jun 03 14:59:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2f4433c-e0c5-4f7f-87c4-9b36c806c313 tempest-SnapshotDependencyTests-2055539547 None] Lock "cinder-c1a562a4-1f3b-4fff-a020-14dfa26d6af9-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:10 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=64,cinder:UPDATE=78,cinder:DELETE=7,cinder:INSERT=15 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:59:11 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=77,cinder:SELECT=81,cinder:INSERT=18,cinder:DELETE=1 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 14:59:13 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:59:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Flow 'volume_create_manager' (c26978c3-5c29-4e87-9c19-df410ad33ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e32afb-a9bb-4d57-bffa-1f0c5817fb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e32afb-a9bb-4d57-bffa-1f0c5817fb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1490153968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a604dbf-331d-49c7-886d-1b5d063fb66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea57eaff89bf4bfb9865b7f50bbeed25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:14Z,use_quota=True,user_id='b028f5e5cb344c429fb1e54de875d074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6aff97-83d5-4cb9-a965-74e23803da93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6aff97-83d5-4cb9-a965-74e23803da93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1789bb-e7e1-46aa-9cf9-1bc7052a0948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1789bb-e7e1-46aa-9cf9-1bc7052a0948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a604dbf-331d-49c7-886d-1b5d063fb66c', 'volume_name': 'volume-0a604dbf-331d-49c7-886d-1b5d063fb66c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e1970b-8682-4378-a297-df3716bf9503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e1970b-8682-4378-a297-df3716bf9503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522320a0-a92d-4f97-aff9-eb1f66e592a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:14 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Volume 0a604dbf-331d-49c7-886d-1b5d063fb66c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a604dbf-331d-49c7-886d-1b5d063fb66c', 'volume_size': 1} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1490153968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a604dbf-331d-49c7-886d-1b5d063fb66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea57eaff89bf4bfb9865b7f50bbeed25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:14Z,use_quota=True,user_id='b028f5e5cb344c429fb1e54de875d074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Creating volume 0a604dbf-331d-49c7-886d-1b5d063fb66c {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:59:14 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:14 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c 1073741824 Jun 03 14:59:14 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:14 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c 1073741824" returned: 0 in 0.755s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:14 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c Jun 03 14:59:14 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:15 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c" returned: 0 in 0.584s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:59:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522320a0-a92d-4f97-aff9-eb1f66e592a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a604dbf-331d-49c7-886d-1b5d063fb66c', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04c0a03-2c07-4e32-a74f-8c6ebde07f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:15 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Volume volume-0a604dbf-331d-49c7-886d-1b5d063fb66c (0a604dbf-331d-49c7-886d-1b5d063fb66c): created successfully Jun 03 14:59:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04c0a03-2c07-4e32-a74f-8c6ebde07f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Flow 'volume_create_manager' (c26978c3-5c29-4e87-9c19-df410ad33ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:15 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-50d2ce8d-afd7-4569-9f9a-f7158b27e938 tempest-VolumeQuotasAdminTestJSON-258656336 None] Created volume successfully. Jun 03 14:59:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Acquiring lock "cinder-0a604dbf-331d-49c7-886d-1b5d063fb66c-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:59:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "cinder-0a604dbf-331d-49c7-886d-1b5d063fb66c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:59:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Acquiring lock "cinder-quobyte-0a604dbf-331d-49c7-886d-1b5d063fb66c" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:59:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "cinder-quobyte-0a604dbf-331d-49c7-886d-1b5d063fb66c" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:59:16 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[de50e867-4441-46b6-b61d-b06a0cb6989c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:16 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c Jun 03 14:59:16 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:16 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c" returned: 0 in 0.712s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:16 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c Jun 03 14:59:16 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:17 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-0a604dbf-331d-49c7-886d-1b5d063fb66c" returned: 0 in 0.602s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "cinder-quobyte-0a604dbf-331d-49c7-886d-1b5d063fb66c" released by "delete_volume" :: held 1.355s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:17 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Created reservations ['157bbe93-8a8d-4f71-8784-68dd5eb57244', 'e1285b26-919c-4109-b262-28ab6af67452', '93e1dab4-7275-4e73-bb32-76ed22518c00', '62c96807-6294-43bb-a941-50e6eec5c0cb'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:59:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:17 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:59:17 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:18 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.580s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:59:18 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Deleted volume successfully. Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fb15bb43-1a06-460f-b558-68e4be59ec7e tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "cinder-0a604dbf-331d-49c7-886d-1b5d063fb66c-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Flow 'volume_create_manager' (e0c3b7d9-89ec-437f-881f-1f31214476a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dcdc27-d087-49eb-8e1c-7961a7b486c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dcdc27-d087-49eb-8e1c-7961a7b486c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-902373081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02dc47d-2a45-4ac8-b25a-d1b00cce74b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea57eaff89bf4bfb9865b7f50bbeed25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:19Z,use_quota=True,user_id='b028f5e5cb344c429fb1e54de875d074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe138e4-63ab-4519-bf3c-0cd54001dbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe138e4-63ab-4519-bf3c-0cd54001dbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16085972-cb5f-423d-9632-3f2861f492de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16085972-cb5f-423d-9632-3f2861f492de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02dc47d-2a45-4ac8-b25a-d1b00cce74b7', 'volume_name': 'volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7db8fd-4620-43cb-aad5-7165ae6793d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7db8fd-4620-43cb-aad5-7165ae6793d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64da085-2131-483d-974e-b06f49d55f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:18 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Volume c02dc47d-2a45-4ac8-b25a-d1b00cce74b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7', 'volume_size': 1} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-902373081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02dc47d-2a45-4ac8-b25a-d1b00cce74b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea57eaff89bf4bfb9865b7f50bbeed25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:19Z,use_quota=True,user_id='b028f5e5cb344c429fb1e54de875d074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Creating volume c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:59:18 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:59:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:18 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 1073741824 Jun 03 14:59:18 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:19 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 1073741824" returned: 0 in 0.777s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:19 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 Jun 03 14:59:19 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Flow 'volume_create_manager' (02dca667-18b5-4f23-b9cc-a76b6d3b12d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a739ae74-d8fe-4680-83da-7b464971782e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a739ae74-d8fe-4680-83da-7b464971782e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-633991338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0038cfa-3322-4cd9-b6d3-88de8886b947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dab37f5ff244b8090a1e458501b9859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:20Z,use_quota=True,user_id='4dbf667e29ee4e06a1b5e3a6ad4e040b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48ba82a-cd53-4d1a-92bb-1eaa1dc73af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48ba82a-cd53-4d1a-92bb-1eaa1dc73af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc6a763-2a5e-4237-835d-38fbb011dd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc6a763-2a5e-4237-835d-38fbb011dd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0038cfa-3322-4cd9-b6d3-88de8886b947', 'volume_name': 'volume-d0038cfa-3322-4cd9-b6d3-88de8886b947', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d0b6d2-b48d-479b-9b28-60f4f54c2655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d0b6d2-b48d-479b-9b28-60f4f54c2655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4316cbe5-c0a5-458c-9165-3b3d941617ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:20 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Volume d0038cfa-3322-4cd9-b6d3-88de8886b947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0038cfa-3322-4cd9-b6d3-88de8886b947', 'volume_size': 1} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:20 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7" returned: 0 in 0.619s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-633991338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0038cfa-3322-4cd9-b6d3-88de8886b947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dab37f5ff244b8090a1e458501b9859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:20Z,use_quota=True,user_id='4dbf667e29ee4e06a1b5e3a6ad4e040b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Creating volume d0038cfa-3322-4cd9-b6d3-88de8886b947 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:59:20 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64da085-2131-483d-974e-b06f49d55f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:20 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 1073741824 Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf7d52f-40fd-4f6f-b8f7-5c7c720e431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:20 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:20 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Volume volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 (c02dc47d-2a45-4ac8-b25a-d1b00cce74b7): created successfully Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf7d52f-40fd-4f6f-b8f7-5c7c720e431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Flow 'volume_create_manager' (e0c3b7d9-89ec-437f-881f-1f31214476a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:20 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-40813324-ca7d-4ad9-90a5-0419611017c5 tempest-VolumeQuotasAdminTestJSON-258656336 None] Created volume successfully. Jun 03 14:59:21 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 1073741824" returned: 0 in 0.781s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:21 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 Jun 03 14:59:21 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-70b4cb48-f6cc-45ec-829c-8f7b81f1935b tempest-VolumeQuotasAdminTestJSON-1173323153 None] Transfer volume completed successfully. Jun 03 14:59:21 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947" returned: 0 in 0.587s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:59:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4316cbe5-c0a5-458c-9165-3b3d941617ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0038cfa-3322-4cd9-b6d3-88de8886b947', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1fa787-bd25-4d37-b886-08a8685ffb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:21 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Volume volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 (d0038cfa-3322-4cd9-b6d3-88de8886b947): created successfully Jun 03 14:59:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1fa787-bd25-4d37-b886-08a8685ffb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:21 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Flow 'volume_create_manager' (02dca667-18b5-4f23-b9cc-a76b6d3b12d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-9d4c91e8-5361-43c6-8158-7921458cc12b tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Created volume successfully. Jun 03 14:59:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Acquiring lock "cinder-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:59:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Lock "cinder-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:59:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Acquiring lock "cinder-quobyte-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:59:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Lock "cinder-quobyte-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:59:22 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee6dade-ea2b-42ae-9de5-5e0278aca6ee]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:22 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 Jun 03 14:59:22 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:23 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7" returned: 0 in 0.707s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:23 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7 Jun 03 14:59:23 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:23 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7" returned: 0 in 0.584s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Lock "cinder-quobyte-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7" released by "delete_volume" :: held 1.337s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Created reservations ['8e2e88c0-90cb-437d-b632-522b00a7ff7d', '997a133c-e7a7-45d5-8bf7-a726025bf83e', '29364cbb-6ba7-4eb2-b704-319448d9bb34', '3b689d17-8689-4095-a4c5-0797e82fa848'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:23 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:59:23 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:24 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.575s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:24 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:59:24 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Deleted volume successfully. Jun 03 14:59:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-5e9dbd43-999f-4b7b-bb1c-ec8fb9099577 tempest-VolumeQuotasAdminTestJSON-1784617497 None] Lock "cinder-c02dc47d-2a45-4ac8-b25a-d1b00cce74b7-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-5113dfc1-70b4-4f75-8994-04f680a8e3b5 req-e4ec4678-eabc-4105-9d14-7d43b05000d5 tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-5113dfc1-70b4-4f75-8994-04f680a8e3b5 req-e4ec4678-eabc-4105-9d14-7d43b05000d5 tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:25 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e407a24-1649-4e9c-a57b-1d8a6ccb45a2]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-5113dfc1-70b4-4f75-8994-04f680a8e3b5 req-e4ec4678-eabc-4105-9d14-7d43b05000d5 tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:25 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 Jun 03 14:59:25 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:26 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-5113dfc1-70b4-4f75-8994-04f680a8e3b5 req-e4ec4678-eabc-4105-9d14-7d43b05000d5 tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947" returned: 0 in 0.722s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-5113dfc1-70b4-4f75-8994-04f680a8e3b5 req-e4ec4678-eabc-4105-9d14-7d43b05000d5 tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.741s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-5113dfc1-70b4-4f75-8994-04f680a8e3b5 req-e4ec4678-eabc-4105-9d14-7d43b05000d5 tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-d0038cfa-3322-4cd9-b6d3-88de8886b947', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09179d4e-af30-440e-ab63-e2aa9acbaadc', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 14:59:26 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-5113dfc1-70b4-4f75-8994-04f680a8e3b5 req-e4ec4678-eabc-4105-9d14-7d43b05000d5 tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] attachment_update completed successfully. Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Flow 'volume_create_manager' (945862f3-6f0a-434c-99ea-def4b9c5c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676bee99-44e3-465d-9b8d-f52ad2587065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676bee99-44e3-465d-9b8d-f52ad2587065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2019395564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56fb5d6-1486-4e51-ac58-9cd8a95e9da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56bf5faa1cf4033ae64a754d8e37a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:31Z,use_quota=True,user_id='8baa242b647443b499a8f294b5b21947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281d5e9d-5a9f-4dfa-8360-f2616fd07818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281d5e9d-5a9f-4dfa-8360-f2616fd07818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61ca8c8-c4f4-49a6-9e9a-d32e6c4e0353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61ca8c8-c4f4-49a6-9e9a-d32e6c4e0353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56fb5d6-1486-4e51-ac58-9cd8a95e9da4', 'volume_name': 'volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b575216-40c0-41d3-8d89-84ddf8006951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b575216-40c0-41d3-8d89-84ddf8006951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa2907f-11d4-4f1a-a0bc-7c40e63cc8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:30 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Volume e56fb5d6-1486-4e51-ac58-9cd8a95e9da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4', 'volume_size': 1} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2019395564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56fb5d6-1486-4e51-ac58-9cd8a95e9da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56bf5faa1cf4033ae64a754d8e37a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:31Z,use_quota=True,user_id='8baa242b647443b499a8f294b5b21947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Creating volume e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:59:30 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:59:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:30 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 1073741824 Jun 03 14:59:30 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:31 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 1073741824" returned: 0 in 0.861s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:31 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 Jun 03 14:59:31 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:32 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4" returned: 0 in 0.584s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:59:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa2907f-11d4-4f1a-a0bc-7c40e63cc8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1c9ac9-7ef9-4952-a881-27e027788966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:32 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Volume volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 (e56fb5d6-1486-4e51-ac58-9cd8a95e9da4): created successfully Jun 03 14:59:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1c9ac9-7ef9-4952-a881-27e027788966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Flow 'volume_create_manager' (945862f3-6f0a-434c-99ea-def4b9c5c452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:32 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-74b3030d-6e87-4e32-b53b-ed23a24e3b87 tempest-VolumesServicesTestJSON-938984619 None] Created volume successfully. Jun 03 14:59:33 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-b9e74732-17a1-4384-9e3e-86c53bba9c2c req-1009159f-c65d-4c5d-a641-3082feb127a8 tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Terminate volume connection completed successfully. Jun 03 14:59:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-b9e74732-17a1-4384-9e3e-86c53bba9c2c req-1009159f-c65d-4c5d-a641-3082feb127a8 tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Deleting attachment 09179d4e-af30-440e-ab63-e2aa9acbaadc. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 14:59:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Acquiring lock "cinder-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:59:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Lock "cinder-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:59:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Acquiring lock "cinder-quobyte-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:59:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Lock "cinder-quobyte-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:59:33 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f4d357-9217-46be-a100-e7b23492bba2]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:33 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 Jun 03 14:59:33 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:33 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4" returned: 0 in 0.704s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:33 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4 Jun 03 14:59:33 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:34 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4" returned: 0 in 0.580s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Lock "cinder-quobyte-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4" released by "delete_volume" :: held 1.321s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:34 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Created reservations ['4493b8a1-a153-4f5b-8951-86d5ca96f85e', '40261d57-0636-4152-a058-589ea5d1eb9e', '37ff4a19-6ff3-42fd-ac5b-b5ce911ba80f', '2e613a01-abfa-492e-bc5c-f0af59cd913f'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:59:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:34 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:59:34 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Acquiring lock "cinder-d0038cfa-3322-4cd9-b6d3-88de8886b947-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "cinder-d0038cfa-3322-4cd9-b6d3-88de8886b947-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:59:35 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.592s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:59:35 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Deleted volume successfully. Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Acquiring lock "cinder-quobyte-d0038cfa-3322-4cd9-b6d3-88de8886b947" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "cinder-quobyte-d0038cfa-3322-4cd9-b6d3-88de8886b947" acquired by "delete_volume" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad510347-c15c-45de-b781-3e52dbfcb2dc tempest-VolumesServicesTestJSON-938984619 None] Lock "cinder-e56fb5d6-1486-4e51-ac58-9cd8a95e9da4-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d668537b-10b6-43b5-908d-20d164044a1b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:35 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 Jun 03 14:59:35 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:35 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947" returned: 0 in 0.724s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:35 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947 Jun 03 14:59:35 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:36 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d0038cfa-3322-4cd9-b6d3-88de8886b947" returned: 0 in 0.597s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "cinder-quobyte-d0038cfa-3322-4cd9-b6d3-88de8886b947" released by "delete_volume" :: held 1.367s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:36 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Created reservations ['5a489ea9-90b2-4008-99a3-ed6c31345688', '4ca8567e-a7f3-4fab-b8f9-2f44eb944a2c', '759b6ac1-6506-49cd-aa9f-b00d074ff8d8', '92e769fc-beb4-45f9-8b16-ccd7554b4812'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:59:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:36 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:59:36 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:37 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.627s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:37 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:59:37 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Deleted volume successfully. Jun 03 14:59:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b3493d73-634b-464b-ae67-3647e36816ca tempest-TestServerVolumeAttachScenarioOldVersion-1789388587 None] Lock "cinder-d0038cfa-3322-4cd9-b6d3-88de8886b947-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:41 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Flow 'volume_create_manager' (ecc07a87-2582-42e9-9cdf-49c8fb56066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7346df5-18d8-4ffd-9170-d7cdad85828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7346df5-18d8-4ffd-9170-d7cdad85828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1720314764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f5631b-7c7e-4064-83f9-100f30009c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d05c2d1c766414a9f6e697791ef5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:42Z,use_quota=True,user_id='0912494547154e359abd80c08a788277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33950904-0e9c-487e-bdca-e4902dcac761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33950904-0e9c-487e-bdca-e4902dcac761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb34a7a3-2785-42b8-ba0c-74b5370bb250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.image.glance [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Creating Keystone auth plugin from conf {{(pid=86614) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb34a7a3-2785-42b8-ba0c-74b5370bb250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '75f5631b-7c7e-4064-83f9-100f30009c38', 'volume_name': 'volume-75f5631b-7c7e-4064-83f9-100f30009c38', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f82b881-fb91-4a3e-85e1-548b75b1283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f82b881-fb91-4a3e-85e1-548b75b1283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abd7a64-0f97-473b-b905-cc515205837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:42 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Volume 75f5631b-7c7e-4064-83f9-100f30009c38: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-75f5631b-7c7e-4064-83f9-100f30009c38', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Trying to clone 75f5631b-7c7e-4064-83f9-100f30009c38 from image 839cbef2-b314-44e2-9fd2-f453c1210770 at location (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]). {{(pid=86614) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 03 14:59:42 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Image download 20.69 MB at 20.69 MB/s Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96eb6b6-98cf-413c-85aa-7af467cf989c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:42 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD Jun 03 14:59:42 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:43 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD" returned: 0 in 0.669s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:43 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Temporary image 839cbef2-b314-44e2-9fd2-f453c1210770 is fetched for user 0912494547154e359abd80c08a788277. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 03 14:59:43 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ff0e3c-2020-4bc9-bf57-a4e3d635194c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:43 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD Jun 03 14:59:43 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:44 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD" returned: 0 in 0.667s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1720314764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f5631b-7c7e-4064-83f9-100f30009c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d05c2d1c766414a9f6e697791ef5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:42Z,use_quota=True,user_id='0912494547154e359abd80c08a788277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Creating volume 75f5631b-7c7e-4064-83f9-100f30009c38 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:59:44 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:44 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 1073741824 Jun 03 14:59:44 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:44 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 1073741824" returned: 0 in 0.753s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:44 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 Jun 03 14:59:44 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:45 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38" returned: 0 in 0.630s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:45 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 14:59:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:45 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Attempting download of 839cbef2-b314-44e2-9fd2-f453c1210770 ((None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}])) to volume 75f5631b-7c7e-4064-83f9-100f30009c38. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 03 14:59:45 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36b9919-a071-44f6-9713-78370b18eb43]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_fmjcfn59 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:45 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_fmjcfn59 Jun 03 14:59:45 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:46 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_fmjcfn59" returned: 0 in 0.678s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_fmjcfn59 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:46 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_fmjcfn59 Jun 03 14:59:46 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:46 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_fmjcfn59" returned: 1 in 0.686s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_839cbef2-b314-44e2-9fd2-f453c1210770_fmjcfn59' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:59:47 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee8e0cd-c332-4687-a127-5e444056a909]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:47 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD Jun 03 14:59:47 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:47 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD" returned: 0 in 0.696s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:47 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] 839cbef2-b314-44e2-9fd2-f453c1210770 was qcow2, converting to raw {{(pid=86614) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 03 14:59:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:47 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 Jun 03 14:59:47 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:49 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38" returned: 0 in 1.962s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:49 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_839cbef2-b314-44e2-9fd2-f453c1210770_4q2jz86mdevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 14:59:49 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Converted 112.00 MB image at 57.05 MB/s Jun 03 14:59:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:49 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 1G Jun 03 14:59:49 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:50 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 1G" returned: 0 in 0.650s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:50 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f6277-dd2d-460b-bfe2-80ec10a6598d]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:50 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 Jun 03 14:59:50 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:51 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38" returned: 0 in 0.708s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:51 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 Jun 03 14:59:51 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:51 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38" returned: 1 in 0.761s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Downloaded image 839cbef2-b314-44e2-9fd2-f453c1210770 ((None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}])) to volume 75f5631b-7c7e-4064-83f9-100f30009c38 successfully. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Temporary image 839cbef2-b314-44e2-9fd2-f453c1210770 for user 0912494547154e359abd80c08a788277 is deleted. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Marking volume 75f5631b-7c7e-4064-83f9-100f30009c38 as bootable. {{(pid=86614) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Copying metadata from image 839cbef2-b314-44e2-9fd2-f453c1210770 to 75f5631b-7c7e-4064-83f9-100f30009c38. {{(pid=86614) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Creating volume glance metadata for volume 75f5631b-7c7e-4064-83f9-100f30009c38 backed by image 839cbef2-b314-44e2-9fd2-f453c1210770 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86614) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abd7a64-0f97-473b-b905-cc515205837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75f5631b-7c7e-4064-83f9-100f30009c38', 'volume_size': 1, 'image_id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/839cbef2-b314-44e2-9fd2-f453c1210770', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb6b489c2d814e659c68ddae560812de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '839cbef2-b314-44e2-9fd2-f453c1210770', 'created_at': datetime.datetime(2026, 6, 3, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 12, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/839cbef2-b314-44e2-9fd2-f453c1210770/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7b2e81-a3c0-4a16-aec4-361bc65cfbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:51 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Volume volume-75f5631b-7c7e-4064-83f9-100f30009c38 (75f5631b-7c7e-4064-83f9-100f30009c38): created successfully Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7b2e81-a3c0-4a16-aec4-361bc65cfbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Flow 'volume_create_manager' (ecc07a87-2582-42e9-9cdf-49c8fb56066a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:51 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-72a67888-fc44-474f-ac28-c31bd0674490 tempest-VolumesImageMetadata-418183450 None] Created volume successfully. Jun 03 14:59:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Acquiring lock "cinder-75f5631b-7c7e-4064-83f9-100f30009c38-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:59:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Lock "cinder-75f5631b-7c7e-4064-83f9-100f30009c38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:59:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Acquiring lock "cinder-quobyte-75f5631b-7c7e-4064-83f9-100f30009c38" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 14:59:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Lock "cinder-quobyte-75f5631b-7c7e-4064-83f9-100f30009c38" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b37e6c3-f796-4aa9-8be4-960a534ec444]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:53 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 Jun 03 14:59:53 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:53 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38" returned: 0 in 0.702s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:53 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:59:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:53 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:53 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 Jun 03 14:59:53 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:54 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.696s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:59:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 14:59:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 14:59:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 14:59:54 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38" returned: 1 in 0.726s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 14:59:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:54 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38 Jun 03 14:59:54 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:55 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-75f5631b-7c7e-4064-83f9-100f30009c38" returned: 0 in 0.601s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Lock "cinder-quobyte-75f5631b-7c7e-4064-83f9-100f30009c38" released by "delete_volume" :: held 2.093s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Created reservations ['41090ed2-288d-4de6-918d-87395c17a9c5', 'b8479456-b23c-4b56-b353-ec587f6f430c', 'f2c17728-61a1-4677-b830-8f13abcfbdd4', '07e77c08-195c-493d-a195-0ee9398c3d53'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:55 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 14:59:55 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:55 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.621s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 14:59:55 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Deleted volume successfully. Jun 03 14:59:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b97e1818-699c-4b98-858c-bbf91eba1c58 tempest-VolumesImageMetadata-418183450 None] Lock "cinder-75f5631b-7c7e-4064-83f9-100f30009c38-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Flow 'volume_create_manager' (fe300e1b-a3c5-4fa3-84ef-c24a97e45e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029106a8-f326-470c-83f2-8088d71cdac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029106a8-f326-470c-83f2-8088d71cdac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1021757055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444b3fd5-915b-476e-8fd7-9eb198e1e85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceedfae75dd4d01b79aa645e5dcd180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:59Z,use_quota=True,user_id='7c4ff8a4833d499494ea92f38e6d1df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18a8f0f-36e0-40c2-9d7e-60e084e32b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18a8f0f-36e0-40c2-9d7e-60e084e32b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2206f48a-7bbb-4573-b84f-021b23ac15f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2206f48a-7bbb-4573-b84f-021b23ac15f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444b3fd5-915b-476e-8fd7-9eb198e1e85a', 'volume_name': 'volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d97c01-b00c-4dab-b0f9-433ee0b38e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d97c01-b00c-4dab-b0f9-433ee0b38e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c37499-50ed-4920-a780-0bd08ecdd1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 14:59:58 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Volume 444b3fd5-915b-476e-8fd7-9eb198e1e85a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a', 'volume_size': 1} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T12:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1021757055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444b3fd5-915b-476e-8fd7-9eb198e1e85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceedfae75dd4d01b79aa645e5dcd180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T12:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T12:59:59Z,use_quota=True,user_id='7c4ff8a4833d499494ea92f38e6d1df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Creating volume 444b3fd5-915b-476e-8fd7-9eb198e1e85a {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 14:59:58 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 14:59:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:58 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a 1073741824 Jun 03 14:59:58 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 14:59:59 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jun 03 14:59:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a 1073741824" returned: 0 in 0.828s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 14:59:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 14:59:59 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a Jun 03 14:59:59 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:00 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a" returned: 0 in 0.608s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:00:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c37499-50ed-4920-a780-0bd08ecdd1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea14d2e-a6b0-4c0e-a76e-7432bdf845f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:00 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Volume volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a (444b3fd5-915b-476e-8fd7-9eb198e1e85a): created successfully Jun 03 15:00:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea14d2e-a6b0-4c0e-a76e-7432bdf845f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:00 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Flow 'volume_create_manager' (fe300e1b-a3c5-4fa3-84ef-c24a97e45e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:00:00 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d5585670-dadc-4874-9170-b7f629420eeb tempest-SnapshotMetadataTestJSON-1046677295 None] Created volume successfully. Jun 03 15:00:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Creating offline snapshot 3cafe3c0-f790-4f9e-8838-f5eda5daf68a of volume 444b3fd5-915b-476e-8fd7-9eb198e1e85a {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 15:00:01 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[c476c38b-b05b-4e6a-846c-da40e857e30d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:00:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:01 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a Jun 03 15:00:01 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:02 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a" returned: 0 in 0.772s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:02 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a 1G Jun 03 15:00:02 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:03 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a 1G" returned: 0 in 0.970s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:03 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a Jun 03 15:00:03 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:03 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a" returned: 0 in 0.664s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:03 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a is being set with open permissions: ugo+rw Jun 03 15:00:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:03 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a Jun 03 15:00:03 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:04 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a" returned: 0 in 0.617s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:04 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.info Jun 03 15:00:04 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:04 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.info" returned: 0 in 0.636s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:05 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.info is being set with open permissions: ugo+rw Jun 03 15:00:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:05 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.info Jun 03 15:00:05 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:05 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.info" returned: 0 in 0.589s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.358s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:05 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-0e45c015-b4ae-4de6-988c-ecdbcbe455b6 tempest-SnapshotMetadataTestJSON-1046677295 None] Create snapshot completed successfully Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Acquiring lock "cinder-3cafe3c0-f790-4f9e-8838-f5eda5daf68a-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "cinder-3cafe3c0-f790-4f9e-8838-f5eda5daf68a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Acquiring lock "cinder-quobyte-444b3fd5-915b-476e-8fd7-9eb198e1e85a" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "cinder-quobyte-444b3fd5-915b-476e-8fd7-9eb198e1e85a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Acquiring lock "cinder-quobyte-3cafe3c0-f790-4f9e-8838-f5eda5daf68a" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "cinder-quobyte-3cafe3c0-f790-4f9e-8838-f5eda5daf68a" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Deleting offline snapshot 3cafe3c0-f790-4f9e-8838-f5eda5daf68a of volume 444b3fd5-915b-476e-8fd7-9eb198e1e85a {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] snapshot_file for this snap is: volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f87009-c048-4e50-be29-16991b91c190]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:07 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a Jun 03 15:00:07 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:07 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a" returned: 0 in 0.740s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 15:00:08 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[246004e1-1ac3-43bb-8894-16c8ef9d1c11]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:00:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:08 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a Jun 03 15:00:08 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:08 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a" returned: 0 in 0.711s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:08 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a Jun 03 15:00:08 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:09 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a" returned: 0 in 0.772s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:09 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a Jun 03 15:00:09 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:10 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a.3cafe3c0-f790-4f9e-8838-f5eda5daf68a" returned: 0 in 0.616s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "cinder-quobyte-3cafe3c0-f790-4f9e-8838-f5eda5daf68a" released by "_delete_snapshot" :: held 2.957s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:00:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "cinder-quobyte-444b3fd5-915b-476e-8fd7-9eb198e1e85a" released by "delete_snapshot" :: held 3.024s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:00:10 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Created reservations ['05b9b369-0e13-42de-817c-e3f3c588fa99', '023f14ff-5bb1-4746-9284-cc4cf01a5da4', '4b799ad8-30d3-4e92-9bdb-edd740529d99', 'a0ec5e4e-9ad5-43a9-9d12-74a9db833b88'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:00:10 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Delete snapshot completed successfully. Jun 03 15:00:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fc2de819-52d4-472f-bb56-bf8545b8b646 tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "cinder-3cafe3c0-f790-4f9e-8838-f5eda5daf68a-delete_snapshot" released by "delete_snapshot" :: held 3.186s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:00:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Acquiring lock "cinder-444b3fd5-915b-476e-8fd7-9eb198e1e85a-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:00:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "cinder-444b3fd5-915b-476e-8fd7-9eb198e1e85a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:00:11 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=66,cinder:UPDATE=71,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:00:11 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=56,cinder:UPDATE=66,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:00:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Acquiring lock "cinder-quobyte-444b3fd5-915b-476e-8fd7-9eb198e1e85a" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:00:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "cinder-quobyte-444b3fd5-915b-476e-8fd7-9eb198e1e85a" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:00:11 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[57476acf-33c7-445e-931f-be1bbcb6da28]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:00:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:11 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a Jun 03 15:00:11 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:12 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a" returned: 0 in 0.724s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:12 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a Jun 03 15:00:12 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:12 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-444b3fd5-915b-476e-8fd7-9eb198e1e85a" returned: 0 in 0.592s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "cinder-quobyte-444b3fd5-915b-476e-8fd7-9eb198e1e85a" released by "delete_volume" :: held 1.383s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:00:12 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Created reservations ['1ab1e999-b5a0-45e7-b444-a73c53e72585', 'c2d58076-fe1c-4ea3-9429-b09febaab84a', '0ad7c25b-c29d-413d-9d65-ff1921d7121f', '904f130d-5117-437f-beb3-91ee42630e0c'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:00:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:00:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:00:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:13 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:00:13 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:13 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.621s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:13 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:00:13 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Deleted volume successfully. Jun 03 15:00:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-ad9852d0-d5f2-4b38-a8b5-868a852af90f tempest-SnapshotMetadataTestJSON-1046677295 None] Lock "cinder-444b3fd5-915b-476e-8fd7-9eb198e1e85a-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Flow 'volume_create_manager' (3ac79f6e-c325-4693-b1d1-ce6d8379a173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f247278a-4d50-429b-b05e-932eafa8af0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f247278a-4d50-429b-b05e-932eafa8af0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1226004800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6692d9e6-d0b1-41e5-8593-019828ad6a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5336603f8a4d1bba6c1c409bc3a96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:00:14Z,use_quota=True,user_id='62b69e2707124b09901987498f535f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3141dfc4-7798-4d8e-bd5c-2c1c780734c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3141dfc4-7798-4d8e-bd5c-2c1c780734c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5568d755-a644-4abd-94a3-008c51463aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5568d755-a644-4abd-94a3-008c51463aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6692d9e6-d0b1-41e5-8593-019828ad6a8a', 'volume_name': 'volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933a0517-b47e-4117-a09a-dadb6647751b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933a0517-b47e-4117-a09a-dadb6647751b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b623f4-6bf7-4c2e-a34f-21b8acb2af04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:14 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Volume 6692d9e6-d0b1-41e5-8593-019828ad6a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a', 'volume_size': 1} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1226004800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6692d9e6-d0b1-41e5-8593-019828ad6a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5336603f8a4d1bba6c1c409bc3a96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:00:14Z,use_quota=True,user_id='62b69e2707124b09901987498f535f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Creating volume 6692d9e6-d0b1-41e5-8593-019828ad6a8a {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:00:14 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:14 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a 1073741824 Jun 03 15:00:14 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Flow 'volume_create_manager' (5b7027e9-f2b4-4e3e-acb3-924df21bfe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce9b399-ea14-447f-bfb2-6668cacf4781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce9b399-ea14-447f-bfb2-6668cacf4781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-291880481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5336603f8a4d1bba6c1c409bc3a96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:00:15Z,use_quota=True,user_id='62b69e2707124b09901987498f535f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a74392-4d43-48fe-a498-f2267e7db751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a74392-4d43-48fe-a498-f2267e7db751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8df535-359a-4591-9398-87cdcb5af938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8df535-359a-4591-9398-87cdcb5af938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1', 'volume_name': 'volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63efc80b-4654-44ac-afff-ab5e4e871501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63efc80b-4654-44ac-afff-ab5e4e871501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de5ad92-6510-4bd2-b69c-ded8e55cfc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:14 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Volume e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1', 'volume_size': 1} Jun 03 15:00:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:15 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a 1073741824" returned: 0 in 0.943s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:15 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a Jun 03 15:00:15 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:16 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a" returned: 0 in 0.648s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-291880481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5336603f8a4d1bba6c1c409bc3a96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:00:15Z,use_quota=True,user_id='62b69e2707124b09901987498f535f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Creating volume e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:00:16 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:16 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 1073741824 Jun 03 15:00:16 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b623f4-6bf7-4c2e-a34f-21b8acb2af04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38c9266-69cc-45ad-b1ba-f8e54b3a31d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:16 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Volume volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a (6692d9e6-d0b1-41e5-8593-019828ad6a8a): created successfully Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38c9266-69cc-45ad-b1ba-f8e54b3a31d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Flow 'volume_create_manager' (3ac79f6e-c325-4693-b1d1-ce6d8379a173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:00:16 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-302e2195-fab6-4e8c-b8cb-b9656bc6f9d5 tempest-TestServerVolumeAttachmentScenario-950254394 None] Created volume successfully. Jun 03 15:00:16 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 1073741824" returned: 0 in 0.870s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:17 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 Jun 03 15:00:17 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:00:17 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Flow 'volume_create_manager' (5724e1ee-f72d-4789-a6e8-f5a85b426794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba21d620-0f13-4ca3-89af-4e63b4084570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1" returned: 0 in 0.735s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba21d620-0f13-4ca3-89af-4e63b4084570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-383132111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d32895-e767-4e84-b448-e8174a9c7c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6f61670e3144f4aa6b518f6ef6255f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:00:18Z,use_quota=True,user_id='14f592dd761b45e1bd3b6c87c940d06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6899b9af-6985-49da-8e6a-a011afdb7d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6899b9af-6985-49da-8e6a-a011afdb7d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426dabc5-afc5-4a52-91a6-ea4f0d5b457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426dabc5-afc5-4a52-91a6-ea4f0d5b457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d32895-e767-4e84-b448-e8174a9c7c48', 'volume_name': 'volume-a9d32895-e767-4e84-b448-e8174a9c7c48', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ad22bc-3333-44e6-8c8e-517eb2d0c475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ad22bc-3333-44e6-8c8e-517eb2d0c475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489274a1-32b4-41f7-8ebe-9d5337287491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:17 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Volume a9d32895-e767-4e84-b448-e8174a9c7c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d32895-e767-4e84-b448-e8174a9c7c48', 'volume_size': 1} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-383132111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d32895-e767-4e84-b448-e8174a9c7c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6f61670e3144f4aa6b518f6ef6255f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:00:18Z,use_quota=True,user_id='14f592dd761b45e1bd3b6c87c940d06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Creating volume a9d32895-e767-4e84-b448-e8174a9c7c48 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:00:17 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de5ad92-6510-4bd2-b69c-ded8e55cfc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:17 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48 1073741824 Jun 03 15:00:17 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f764f71c-5076-468a-96b4-83d422c79e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:17 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Volume volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 (e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1): created successfully Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f764f71c-5076-468a-96b4-83d422c79e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Flow 'volume_create_manager' (5b7027e9-f2b4-4e3e-acb3-924df21bfe64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:00:17 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d7682055-80bf-4333-9334-78598784e931 tempest-TestServerVolumeAttachmentScenario-950254394 None] Created volume successfully. Jun 03 15:00:18 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48 1073741824" returned: 0 in 0.839s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:18 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48 Jun 03 15:00:18 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:19 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48" returned: 0 in 0.579s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489274a1-32b4-41f7-8ebe-9d5337287491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d32895-e767-4e84-b448-e8174a9c7c48', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60695f88-1dc3-440a-b451-4c4cdf44386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:19 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Volume volume-a9d32895-e767-4e84-b448-e8174a9c7c48 (a9d32895-e767-4e84-b448-e8174a9c7c48): created successfully Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60695f88-1dc3-440a-b451-4c4cdf44386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Flow 'volume_create_manager' (5724e1ee-f72d-4789-a6e8-f5a85b426794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:00:19 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a8f5c5fd-71a8-4c59-bdc3-a5a2b9783e65 tempest-AbsoluteLimitsTests-1210270331 None] Created volume successfully. Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Acquiring lock "cinder-a9d32895-e767-4e84-b448-e8174a9c7c48-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Lock "cinder-a9d32895-e767-4e84-b448-e8174a9c7c48-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Acquiring lock "cinder-quobyte-a9d32895-e767-4e84-b448-e8174a9c7c48" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Lock "cinder-quobyte-a9d32895-e767-4e84-b448-e8174a9c7c48" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7934cf30-c8be-4558-8ccc-4b78eceac010]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:00:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:20 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48 Jun 03 15:00:20 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:20 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48" returned: 0 in 0.675s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:20 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48 Jun 03 15:00:20 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:21 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a9d32895-e767-4e84-b448-e8174a9c7c48" returned: 0 in 0.572s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Lock "cinder-quobyte-a9d32895-e767-4e84-b448-e8174a9c7c48" released by "delete_volume" :: held 1.297s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Created reservations ['51b9d010-4073-4f71-944b-c51f5d80c217', '4555e5a0-b29c-4db5-aa5f-743763a9efe3', 'cb44e127-5c34-47f0-9ef2-9095575f91b2', '4405a527-09cc-4f3d-a4ee-5069e9c2dec2'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:21 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:00:21 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:21 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.582s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:00:21 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Deleted volume successfully. Jun 03 15:00:21 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-bc7f3987-1aa7-47d1-8ba0-3941c0496498 tempest-AbsoluteLimitsTests-1210270331 None] Lock "cinder-a9d32895-e767-4e84-b448-e8174a9c7c48-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Flow 'volume_create_manager' (ae8f0585-bbcc-463a-b0fd-f2839957f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d700ad-fb2b-4bf8-a377-7d489a93f89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d700ad-fb2b-4bf8-a377-7d489a93f89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-232722786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732a28a9-9f88-41c9-9202-862684bf3dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b6c94ee341402f9a00915710c8229e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:00:26Z,use_quota=True,user_id='59c421952cf845d6ba413bbbd936fdc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecca8f06-6551-4c8c-b58f-c7a7104fbbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecca8f06-6551-4c8c-b58f-c7a7104fbbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a66aaaa-5973-4161-bd89-1f66fbdcd36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a66aaaa-5973-4161-bd89-1f66fbdcd36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732a28a9-9f88-41c9-9202-862684bf3dd9', 'volume_name': 'volume-732a28a9-9f88-41c9-9202-862684bf3dd9', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1ff309-fb2a-497e-90d9-0434467ad9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1ff309-fb2a-497e-90d9-0434467ad9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e50c59-f581-419e-b4b7-b86199cbb5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:26 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Volume 732a28a9-9f88-41c9-9202-862684bf3dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732a28a9-9f88-41c9-9202-862684bf3dd9', 'volume_size': 1} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-232722786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732a28a9-9f88-41c9-9202-862684bf3dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b6c94ee341402f9a00915710c8229e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:00:26Z,use_quota=True,user_id='59c421952cf845d6ba413bbbd936fdc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Creating volume 732a28a9-9f88-41c9-9202-862684bf3dd9 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:00:26 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:00:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:26 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9 1073741824 Jun 03 15:00:26 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:27 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9 1073741824" returned: 0 in 0.743s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:27 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9 Jun 03 15:00:27 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:27 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9" returned: 0 in 0.589s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:00:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e50c59-f581-419e-b4b7-b86199cbb5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732a28a9-9f88-41c9-9202-862684bf3dd9', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6d4c9c-982d-42d5-bdc8-95e99ba000d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:00:27 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Volume volume-732a28a9-9f88-41c9-9202-862684bf3dd9 (732a28a9-9f88-41c9-9202-862684bf3dd9): created successfully Jun 03 15:00:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6d4c9c-982d-42d5-bdc8-95e99ba000d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:00:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Flow 'volume_create_manager' (ae8f0585-bbcc-463a-b0fd-f2839957f227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:00:27 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-34287f18-7436-4af5-923e-deab97e3afe7 tempest-VolumesNegativeTest-1909768128 None] Created volume successfully. Jun 03 15:00:43 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=26,cinder:DELETE=4 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:00:43 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:00:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 15:00:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:00:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:00:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:53 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:00:53 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:54 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.669s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:00:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 15:00:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 15:00:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 15:00:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Acquiring lock "cinder-732a28a9-9f88-41c9-9202-862684bf3dd9-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:00:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Lock "cinder-732a28a9-9f88-41c9-9202-862684bf3dd9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Acquiring lock "cinder-quobyte-732a28a9-9f88-41c9-9202-862684bf3dd9" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Lock "cinder-quobyte-732a28a9-9f88-41c9-9202-862684bf3dd9" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c7a30b-bd84-4129-b8f6-3da7a38e6ca4]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:57 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9 Jun 03 15:00:57 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-79a40c99-7bbb-489c-a82f-dd2c2d99a090 req-b00f9b8b-422a-486d-a1e7-7804e7a5ad9d tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-79a40c99-7bbb-489c-a82f-dd2c2d99a090 req-b00f9b8b-422a-486d-a1e7-7804e7a5ad9d tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0f7627-6795-4030-afc1-a7f64e419104]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-79a40c99-7bbb-489c-a82f-dd2c2d99a090 req-b00f9b8b-422a-486d-a1e7-7804e7a5ad9d tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:57 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a Jun 03 15:00:57 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:57 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9" returned: 0 in 0.734s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:57 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9 Jun 03 15:00:57 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:57 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-79a40c99-7bbb-489c-a82f-dd2c2d99a090 req-b00f9b8b-422a-486d-a1e7-7804e7a5ad9d tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a" returned: 0 in 0.710s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-79a40c99-7bbb-489c-a82f-dd2c2d99a090 req-b00f9b8b-422a-486d-a1e7-7804e7a5ad9d tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.729s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-79a40c99-7bbb-489c-a82f-dd2c2d99a090 req-b00f9b8b-422a-486d-a1e7-7804e7a5ad9d tempest-TestServerVolumeAttachmentScenario-950254394 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa3419c8-cb25-48b4-989c-7bf4a9f539c7', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 15:00:58 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-79a40c99-7bbb-489c-a82f-dd2c2d99a090 req-b00f9b8b-422a-486d-a1e7-7804e7a5ad9d tempest-TestServerVolumeAttachmentScenario-950254394 None] attachment_update completed successfully. Jun 03 15:00:58 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-732a28a9-9f88-41c9-9202-862684bf3dd9" returned: 0 in 0.637s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Lock "cinder-quobyte-732a28a9-9f88-41c9-9202-862684bf3dd9" released by "delete_volume" :: held 1.421s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:00:58 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Created reservations ['308e4eb0-21ec-4a1f-89d9-69bca2725919', '8a77f8ea-d699-43f4-ab79-25798fc46b90', 'dbacc9a7-8c94-4f86-ad7a-4976950f8c6b', '17fda268-4b9d-4a28-bc27-bf8f624b62e5'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:00:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:00:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:00:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:00:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:00:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:00:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:00:58 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:00:58 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:00:59 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jun 03 15:00:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.646s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:00:59 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:00:59 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Deleted volume successfully. Jun 03 15:00:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a7eb1713-dee1-4a08-a98b-97438c8525a8 tempest-VolumesNegativeTest-1909768128 None] Lock "cinder-732a28a9-9f88-41c9-9202-862684bf3dd9-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Flow 'volume_create_manager' (fe962c5d-d572-4584-bcb9-edeffcdf1f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1829cb82-def8-4b19-9e76-1d0346a7af8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1829cb82-def8-4b19-9e76-1d0346a7af8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-441986043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00562a82-3b3a-40dd-9e3d-26cbc017050e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce615fca6b047e2a96449ebcca1bb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:01:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:01:02Z,use_quota=True,user_id='9745f8af77b64de0a3fe3a34dbd836e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b778bdd-93fe-437f-8384-18a25bb3c40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b778bdd-93fe-437f-8384-18a25bb3c40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c101995-2545-4b1a-8b27-51b98132b3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c101995-2545-4b1a-8b27-51b98132b3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00562a82-3b3a-40dd-9e3d-26cbc017050e', 'volume_name': 'volume-00562a82-3b3a-40dd-9e3d-26cbc017050e', 'volume_size': 2}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b3d640-f562-40dd-b0e7-19e078eaa616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b3d640-f562-40dd-b0e7-19e078eaa616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edc77c8-4c19-486c-a668-c7d414fdc17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:01 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Volume 00562a82-3b3a-40dd-9e3d-26cbc017050e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00562a82-3b3a-40dd-9e3d-26cbc017050e', 'volume_size': 2} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-441986043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00562a82-3b3a-40dd-9e3d-26cbc017050e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce615fca6b047e2a96449ebcca1bb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:01:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:01:02Z,use_quota=True,user_id='9745f8af77b64de0a3fe3a34dbd836e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Creating volume 00562a82-3b3a-40dd-9e3d-26cbc017050e {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:01:01 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:01:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e 2147483648 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:01 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e 2147483648 Jun 03 15:01:01 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:02 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e 2147483648" returned: 0 in 0.852s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:02 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e Jun 03 15:01:02 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:03 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e" returned: 0 in 0.628s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edc77c8-4c19-486c-a668-c7d414fdc17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00562a82-3b3a-40dd-9e3d-26cbc017050e', 'volume_size': 2}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b98af6-17b4-44ee-a7e1-fc85f9f0e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:03 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Volume volume-00562a82-3b3a-40dd-9e3d-26cbc017050e (00562a82-3b3a-40dd-9e3d-26cbc017050e): created successfully Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b98af6-17b4-44ee-a7e1-fc85f9f0e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Flow 'volume_create_manager' (fe962c5d-d572-4584-bcb9-edeffcdf1f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:01:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a1388bfe-81e5-4be3-8aa0-b4c780c94021 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Created volume successfully. Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Creating offline snapshot ef0771e8-ea94-45fe-aead-240f9f6bb11c of volume 00562a82-3b3a-40dd-9e3d-26cbc017050e {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f35fe9-6d7a-4084-8f32-31c32c2c3630]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:04 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e Jun 03 15:01:04 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:04 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e" returned: 0 in 0.769s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c 2G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:04 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c 2G Jun 03 15:01:04 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:05 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c 2G" returned: 0 in 0.752s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00562a82-3b3a-40dd-9e3d-26cbc017050e -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:05 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00562a82-3b3a-40dd-9e3d-26cbc017050e -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c Jun 03 15:01:05 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:06 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00562a82-3b3a-40dd-9e3d-26cbc017050e -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c" returned: 0 in 0.632s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:06 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c is being set with open permissions: ugo+rw Jun 03 15:01:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:06 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c Jun 03 15:01:06 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:06 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c" returned: 0 in 0.573s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:06 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.info Jun 03 15:01:06 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:07 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.info" returned: 0 in 0.582s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:07 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.info is being set with open permissions: ugo+rw Jun 03 15:01:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:07 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.info Jun 03 15:01:07 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-9c19b4a0-21a9-4363-ba81-18528c33f170 req-4839eef4-7fb7-455d-957d-f18d7b89c0db tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:07 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.info" returned: 0 in 0.598s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.992s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-9c19b4a0-21a9-4363-ba81-18528c33f170 req-4839eef4-7fb7-455d-957d-f18d7b89c0db tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.208s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:07 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae95438-fb06-4b41-a85d-dd9d814085d3]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9c19b4a0-21a9-4363-ba81-18528c33f170 req-4839eef4-7fb7-455d-957d-f18d7b89c0db tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:07 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1bd4a87f-fe9f-473f-aace-6b59b4bf1d74 tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Create snapshot completed successfully Jun 03 15:01:08 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 Jun 03 15:01:08 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Acquiring lock "cinder-ef0771e8-ea94-45fe-aead-240f9f6bb11c-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "cinder-ef0771e8-ea94-45fe-aead-240f9f6bb11c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Acquiring lock "cinder-quobyte-00562a82-3b3a-40dd-9e3d-26cbc017050e" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "cinder-quobyte-00562a82-3b3a-40dd-9e3d-26cbc017050e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Acquiring lock "cinder-quobyte-ef0771e8-ea94-45fe-aead-240f9f6bb11c" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "cinder-quobyte-ef0771e8-ea94-45fe-aead-240f9f6bb11c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Deleting offline snapshot ef0771e8-ea94-45fe-aead-240f9f6bb11c of volume 00562a82-3b3a-40dd-9e3d-26cbc017050e {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] snapshot_file for this snap is: volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c7341d-9f31-4ed7-a675-27c58809f0b3]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:08 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c Jun 03 15:01:08 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:08 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [req-9c19b4a0-21a9-4363-ba81-18528c33f170 req-4839eef4-7fb7-455d-957d-f18d7b89c0db tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1" returned: 0 in 0.721s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [req-9c19b4a0-21a9-4363-ba81-18528c33f170 req-4839eef4-7fb7-455d-957d-f18d7b89c0db tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.740s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-9c19b4a0-21a9-4363-ba81-18528c33f170 req-4839eef4-7fb7-455d-957d-f18d7b89c0db tempest-TestServerVolumeAttachmentScenario-950254394 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33', 'name': 'volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59dfea0e-d83e-4822-a8d9-407bc01c242e', 'enforce_multipath': True} {{(pid=86614) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 03 15:01:08 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-9c19b4a0-21a9-4363-ba81-18528c33f170 req-4839eef4-7fb7-455d-957d-f18d7b89c0db tempest-TestServerVolumeAttachmentScenario-950254394 None] attachment_update completed successfully. Jun 03 15:01:08 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c" returned: 0 in 0.706s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00562a82-3b3a-40dd-9e3d-26cbc017050e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fddcfb-05c4-49b3-a746-92e7f2d8335e]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:09 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e Jun 03 15:01:09 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:09 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e" returned: 0 in 0.681s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:09 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c Jun 03 15:01:09 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:10 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c" returned: 0 in 0.688s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:10 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c Jun 03 15:01:10 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:10 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e.ef0771e8-ea94-45fe-aead-240f9f6bb11c" returned: 0 in 0.604s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "cinder-quobyte-ef0771e8-ea94-45fe-aead-240f9f6bb11c" released by "_delete_snapshot" :: held 2.785s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "cinder-quobyte-00562a82-3b3a-40dd-9e3d-26cbc017050e" released by "delete_snapshot" :: held 2.804s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:11 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Created reservations ['4faebf39-5384-4872-8120-2a3cec0f6f4a', '15aaf7e1-cd32-40c6-9f17-fabaf83d8729', '6dfc9fd4-ceb8-407f-8f6a-9f149110cfe4', '6ad82f71-20f9-4c50-a44f-10f035680d8b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:01:11 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Delete snapshot completed successfully. Jun 03 15:01:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8614a7b1-e372-47d8-be73-91e065e932fe tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "cinder-ef0771e8-ea94-45fe-aead-240f9f6bb11c-delete_snapshot" released by "delete_snapshot" :: held 2.930s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Acquiring lock "cinder-00562a82-3b3a-40dd-9e3d-26cbc017050e-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "cinder-00562a82-3b3a-40dd-9e3d-26cbc017050e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Acquiring lock "cinder-quobyte-00562a82-3b3a-40dd-9e3d-26cbc017050e" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "cinder-quobyte-00562a82-3b3a-40dd-9e3d-26cbc017050e" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:11 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac79605a-871b-4a93-915c-b182dbf86e3b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:11 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e Jun 03 15:01:11 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:12 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e" returned: 0 in 0.687s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:12 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e Jun 03 15:01:12 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:12 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-00562a82-3b3a-40dd-9e3d-26cbc017050e" returned: 0 in 0.605s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "cinder-quobyte-00562a82-3b3a-40dd-9e3d-26cbc017050e" released by "delete_volume" :: held 1.355s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Created reservations ['20076607-eb75-4e6f-8a98-1c117a3bb2e3', '43ccccc5-fce9-4eb3-a429-71d44e8f96be', '48f494f3-469c-4c6f-b79c-8a023f49cfde', '82e0f7ed-114e-4c8b-997f-0d7d90fbf311'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:12 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:01:12 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:13 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.606s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:13 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:01:13 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Deleted volume successfully. Jun 03 15:01:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88542f1f-36f3-4d31-83fe-8fd826a8053c tempest-VolumesSnapshotNegativeTestJSON-1763274632 None] Lock "cinder-00562a82-3b3a-40dd-9e3d-26cbc017050e-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:14 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-1ac3b35c-c0ca-4a32-883c-677fdb013f7e req-7d82eff1-3ffd-483f-859d-dcd76ff77881 tempest-TestServerVolumeAttachmentScenario-950254394 None] Terminate volume connection completed successfully. Jun 03 15:01:14 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-1ac3b35c-c0ca-4a32-883c-677fdb013f7e req-7d82eff1-3ffd-483f-859d-dcd76ff77881 tempest-TestServerVolumeAttachmentScenario-950254394 None] Deleting attachment 59dfea0e-d83e-4822-a8d9-407bc01c242e. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Flow 'volume_create_manager' (657723d5-731b-4fc2-9994-a97b62f213cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae570671-ad15-461f-8fba-32eaaf9f1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae570671-ad15-461f-8fba-32eaaf9f1106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701e7fe3-ae0b-420c-9fa5-d9cbafd6841d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f14e84df1f14a3cb5008cc358db0047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:01:16Z,use_quota=True,user_id='09ca3ba43c604e1dbfbd16965d1ea160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107d479c-0fc1-4173-8d65-8d0bd36c0cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107d479c-0fc1-4173-8d65-8d0bd36c0cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf34713-9ac1-4e4f-aeed-2d194706a078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf34713-9ac1-4e4f-aeed-2d194706a078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701e7fe3-ae0b-420c-9fa5-d9cbafd6841d', 'volume_name': 'volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6022fc8c-3b17-4375-aaef-3d6d731d7484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6022fc8c-3b17-4375-aaef-3d6d731d7484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5299ba42-43a9-49b6-9f5b-28d8a1009f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:16 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Volume 701e7fe3-ae0b-420c-9fa5-d9cbafd6841d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d', 'volume_size': 1} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701e7fe3-ae0b-420c-9fa5-d9cbafd6841d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f14e84df1f14a3cb5008cc358db0047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:01:16Z,use_quota=True,user_id='09ca3ba43c604e1dbfbd16965d1ea160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Creating volume 701e7fe3-ae0b-420c-9fa5-d9cbafd6841d {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:01:16 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:01:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:16 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d 1073741824 Jun 03 15:01:16 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:17 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d 1073741824" returned: 0 in 0.770s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:17 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d Jun 03 15:01:17 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:17 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d" returned: 0 in 0.592s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:01:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5299ba42-43a9-49b6-9f5b-28d8a1009f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370e7010-61e5-456c-9bde-95591339fb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:17 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Volume volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d (701e7fe3-ae0b-420c-9fa5-d9cbafd6841d): created successfully Jun 03 15:01:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370e7010-61e5-456c-9bde-95591339fb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Flow 'volume_create_manager' (657723d5-731b-4fc2-9994-a97b62f213cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:01:17 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-5b4a31b8-1d71-4f6a-a264-6b57a401e1a9 tempest-CinderUnicodeTest-1946237266 None] Created volume successfully. Jun 03 15:01:18 devstack cinder-volume[86614]: INFO cinder.volume.manager [req-e8f39939-b52a-4979-9402-e29229fecc40 req-e1544de8-0306-411a-a5de-2cd3dedf591c tempest-TestServerVolumeAttachmentScenario-950254394 None] Terminate volume connection completed successfully. Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [req-e8f39939-b52a-4979-9402-e29229fecc40 req-e1544de8-0306-411a-a5de-2cd3dedf591c tempest-TestServerVolumeAttachmentScenario-950254394 None] Deleting attachment aa3419c8-cb25-48b4-989c-7bf4a9f539c7. {{(pid=86614) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Flow 'volume_create_manager' (985966da-797f-412d-ae38-4e55a6e86f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d84248d-d715-4786-811f-9c4e153f6042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d84248d-d715-4786-811f-9c4e153f6042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:01:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-123885922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addbbbd1-1928-4125-a776-2b006c26dc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f14e84df1f14a3cb5008cc358db0047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:01:19Z,use_quota=True,user_id='09ca3ba43c604e1dbfbd16965d1ea160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff801929-d19a-4de0-ac56-51623b51316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff801929-d19a-4de0-ac56-51623b51316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7494a7-e059-4daf-b771-964ff956774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7494a7-e059-4daf-b771-964ff956774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'addbbbd1-1928-4125-a776-2b006c26dc38', 'volume_name': 'volume-addbbbd1-1928-4125-a776-2b006c26dc38', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150b0f0b-3db2-4bb8-a27e-24cbc79ee915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150b0f0b-3db2-4bb8-a27e-24cbc79ee915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f1cc68-3ad6-422b-8c74-517ccba4ac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:18 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Volume addbbbd1-1928-4125-a776-2b006c26dc38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-addbbbd1-1928-4125-a776-2b006c26dc38', 'volume_size': 1} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:01:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-123885922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addbbbd1-1928-4125-a776-2b006c26dc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f14e84df1f14a3cb5008cc358db0047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:01:19Z,use_quota=True,user_id='09ca3ba43c604e1dbfbd16965d1ea160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Creating volume addbbbd1-1928-4125-a776-2b006c26dc38 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:01:18 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:01:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:18 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 1073741824 Jun 03 15:01:18 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:19 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 1073741824" returned: 0 in 0.738s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:19 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 Jun 03 15:01:19 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:20 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38" returned: 0 in 0.591s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:01:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f1cc68-3ad6-422b-8c74-517ccba4ac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-addbbbd1-1928-4125-a776-2b006c26dc38', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedc87a1-3998-4ea4-89f9-ef29914c1078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:20 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Volume volume-addbbbd1-1928-4125-a776-2b006c26dc38 (addbbbd1-1928-4125-a776-2b006c26dc38): created successfully Jun 03 15:01:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedc87a1-3998-4ea4-89f9-ef29914c1078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Flow 'volume_create_manager' (985966da-797f-412d-ae38-4e55a6e86f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:01:20 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-031d61cd-e404-4e6a-8eca-3d1fd53774d8 tempest-CinderUnicodeTest-1946237266 None] Created volume successfully. Jun 03 15:01:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Creating offline snapshot 9941bf59-2906-40f3-b420-970f012ab8ea of volume addbbbd1-1928-4125-a776-2b006c26dc38 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 15:01:21 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[55587ec2-3ddd-4f14-984d-2a23eeb42629]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:21 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 Jun 03 15:01:21 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:22 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38" returned: 0 in 1.130s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:22 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea 1G Jun 03 15:01:22 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:23 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea 1G" returned: 0 in 0.820s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addbbbd1-1928-4125-a776-2b006c26dc38 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:23 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addbbbd1-1928-4125-a776-2b006c26dc38 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea Jun 03 15:01:23 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:23 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addbbbd1-1928-4125-a776-2b006c26dc38 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea" returned: 0 in 0.686s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:23 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea is being set with open permissions: ugo+rw Jun 03 15:01:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:23 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea Jun 03 15:01:23 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:24 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea" returned: 0 in 0.624s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:24 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.info Jun 03 15:01:24 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:24 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.info" returned: 0 in 0.610s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:24 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.info is being set with open permissions: ugo+rw Jun 03 15:01:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:24 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.info Jun 03 15:01:24 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:25 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.info" returned: 0 in 0.589s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.554s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-0103ea18-ae09-4f88-886f-34ed2ce83217 tempest-CinderUnicodeTest-1946237266 None] Create snapshot completed successfully Jun 03 15:01:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "cinder-9941bf59-2906-40f3-b420-970f012ab8ea-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-9941bf59-2906-40f3-b420-970f012ab8ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "cinder-quobyte-addbbbd1-1928-4125-a776-2b006c26dc38" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-quobyte-addbbbd1-1928-4125-a776-2b006c26dc38" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "cinder-quobyte-9941bf59-2906-40f3-b420-970f012ab8ea" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-quobyte-9941bf59-2906-40f3-b420-970f012ab8ea" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Deleting offline snapshot 9941bf59-2906-40f3-b420-970f012ab8ea of volume addbbbd1-1928-4125-a776-2b006c26dc38 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 15:01:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] snapshot_file for this snap is: volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 15:01:26 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5408a572-19bd-4a16-8b87-f854a4141ebe]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:26 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea Jun 03 15:01:26 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:27 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea" returned: 0 in 0.678s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-addbbbd1-1928-4125-a776-2b006c26dc38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 15:01:27 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ce16d4-8c96-4aa3-94f7-2b495b77c67e]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:27 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 Jun 03 15:01:27 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:27 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38" returned: 0 in 0.683s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:27 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea Jun 03 15:01:27 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:28 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea" returned: 0 in 0.705s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:28 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea Jun 03 15:01:28 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "cinder-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "cinder-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "cinder-quobyte-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "cinder-quobyte-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:28 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[c682e456-3191-4389-8a47-ce438cd287db]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:28 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 Jun 03 15:01:28 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:29 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38.9941bf59-2906-40f3-b420-970f012ab8ea" returned: 0 in 0.612s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-quobyte-9941bf59-2906-40f3-b420-970f012ab8ea" released by "_delete_snapshot" :: held 2.778s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-quobyte-addbbbd1-1928-4125-a776-2b006c26dc38" released by "delete_snapshot" :: held 2.804s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Created reservations ['5ec289a0-4253-41b6-9115-5c7fc8d0fcd8', '15de7d0c-a16d-42af-8db4-26fe24a4d3c1', '94eb7204-d901-45ce-861d-0b690a3c5524', '7d839636-ea0e-4563-b371-9e670a574d3a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:01:29 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Delete snapshot completed successfully. Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-dafa0228-9911-4235-9656-c43207f0676f tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-9941bf59-2906-40f3-b420-970f012ab8ea-delete_snapshot" released by "delete_snapshot" :: held 2.936s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "cinder-addbbbd1-1928-4125-a776-2b006c26dc38-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-addbbbd1-1928-4125-a776-2b006c26dc38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "cinder-quobyte-addbbbd1-1928-4125-a776-2b006c26dc38" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:29 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1" returned: 0 in 0.739s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-quobyte-addbbbd1-1928-4125-a776-2b006c26dc38" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:29 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1 Jun 03 15:01:29 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc01157-74e1-46ed-8f5c-ad153bccbf76]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:29 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 Jun 03 15:01:29 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:30 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1" returned: 0 in 0.600s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "cinder-quobyte-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1" released by "delete_volume" :: held 1.386s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Created reservations ['eefd7cb8-9157-4165-897d-27d4baacff62', 'd6b18f67-ccfd-47cc-af60-3b73f7974d19', 'f226a036-f29b-42a1-892e-919657a55d5d', 'f524f34d-5b5b-44f3-92ec-5dc5f99dfed1'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:30 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:01:30 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:30 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38" returned: 0 in 0.753s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:30 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38 Jun 03 15:01:30 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:30 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.583s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:01:30 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Deleted volume successfully. Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-98039cd6-b5fa-453c-b3b7-9c77a8155043 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "cinder-e1ebb6f8-15c8-4a0a-8b7e-cf22e50b51d1-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "cinder-6692d9e6-d0b1-41e5-8593-019828ad6a8a-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "cinder-6692d9e6-d0b1-41e5-8593-019828ad6a8a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:30 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-addbbbd1-1928-4125-a776-2b006c26dc38" returned: 0 in 0.606s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-quobyte-addbbbd1-1928-4125-a776-2b006c26dc38" released by "delete_volume" :: held 1.426s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "cinder-quobyte-6692d9e6-d0b1-41e5-8593-019828ad6a8a" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "cinder-quobyte-6692d9e6-d0b1-41e5-8593-019828ad6a8a" acquired by "delete_volume" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cb6690-621f-4c98-b933-afc239984c22]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Created reservations ['33ff4e6f-d939-42c1-9edd-799649e01ef5', '28827cf6-3926-4329-956c-9f570f1364b5', '725c762d-104c-4707-a114-e9a9eeb55fe4', 'dcfe42dc-aebd-4967-be16-3223ba2e39db'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:31 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a Jun 03 15:01:31 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:31 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:01:31 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "cinder-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:31 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.602s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:01:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Deleted volume successfully. Jun 03 15:01:31 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a" returned: 0 in 0.722s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-88678214-f3a5-4ce6-8a84-5c243fdd2f85 tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-addbbbd1-1928-4125-a776-2b006c26dc38-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "cinder-quobyte-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:31 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a Jun 03 15:01:31 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-quobyte-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b661832c-49e9-4135-b366-a158f4b303e6]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:31 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d Jun 03 15:01:31 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:32 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-6692d9e6-d0b1-41e5-8593-019828ad6a8a" returned: 0 in 0.603s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "cinder-quobyte-6692d9e6-d0b1-41e5-8593-019828ad6a8a" released by "delete_volume" :: held 1.375s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Created reservations ['387be722-38c9-4c89-8132-0da8f03a4ab6', '661b81cd-7afe-455f-8812-454cc6690b01', 'f8dee924-37c0-41f1-bb8d-4e566e182318', '3e835eb8-8554-48f4-b37f-4ac9da4e0efb'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:32 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:01:32 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:32 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d" returned: 0 in 0.729s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:32 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d Jun 03 15:01:32 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:33 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.591s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:01:33 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Deleted volume successfully. Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2d408840-34a7-490e-8839-5977e42f4c56 tempest-TestServerVolumeAttachmentScenario-950254394 None] Lock "cinder-6692d9e6-d0b1-41e5-8593-019828ad6a8a-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:33 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d" returned: 0 in 0.636s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-quobyte-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d" released by "delete_volume" :: held 1.404s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Created reservations ['7fc1d95c-aa85-4c1e-8250-606d3534af6c', '66d251f0-a134-4090-8f59-88b3092e1457', '76596aac-f904-41fb-acde-df59b2a8da17', 'b783e91f-fa33-4020-b6a6-3c5f8a5637fa'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:33 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:01:33 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:33 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.645s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:33 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:01:33 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Deleted volume successfully. Jun 03 15:01:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-cdbf1797-3b7c-4600-85d9-60c503a8e2f2 tempest-CinderUnicodeTest-1946237266 None] Lock "cinder-701e7fe3-ae0b-420c-9fa5-d9cbafd6841d-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:43 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=67,cinder:INSERT=21,cinder:UPDATE=74,cinder:DELETE=5 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:01:44 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=74,cinder:SELECT=67,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Flow 'volume_create_manager' (1d36931a-3b6c-4e1f-b091-4d283396df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c435f3e5-030e-4b97-82ae-23eafd932934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c435f3e5-030e-4b97-82ae-23eafd932934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90116819-67d4-42d7-b6d2-e8912c445e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9ca1a7ae554c39a03d5eac34faab71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:01:45Z,use_quota=True,user_id='8c9c97bea4234e1c94ab41da0930a686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49301816-46bb-4299-9d16-e0266503675a),volume_type_id=49301816-46bb-4299-9d16-e0266503675a)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bf468b-b024-469a-a4b0-6688258ba4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bf468b-b024-469a-a4b0-6688258ba4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22a2568-c804-4029-a924-9255ea6ffcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.image.glance [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Creating Keystone auth plugin from conf {{(pid=86614) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22a2568-c804-4029-a924-9255ea6ffcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90116819-67d4-42d7-b6d2-e8912c445e74', 'volume_name': 'volume-90116819-67d4-42d7-b6d2-e8912c445e74', 'volume_size': 1, 'image_id': 'af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b863a65eb3dff72af762498a193aed0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d9ca1a7ae554c39a03d5eac34faab71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bcedf3bd9ab1c740cb768ff5cf6a8ebe51f0642b1e81dab37a7d0f69c524c396b1e074cd4489e34e3e16b5b4ac06c121fb35741413fc2aac704c50f40c80861', 'id': 'af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'created_at': datetime.datetime(2026, 6, 3, 13, 1, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 1, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af8f8b3a-5717-4ce1-8f64-b841fe95ec10/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efeba921-c5d5-4170-bac0-b27e262865e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efeba921-c5d5-4170-bac0-b27e262865e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e5b118-b46d-406d-ae3b-075f68525be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:45 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Volume 90116819-67d4-42d7-b6d2-e8912c445e74: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90116819-67d4-42d7-b6d2-e8912c445e74', 'volume_size': 1, 'image_id': 'af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b863a65eb3dff72af762498a193aed0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d9ca1a7ae554c39a03d5eac34faab71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bcedf3bd9ab1c740cb768ff5cf6a8ebe51f0642b1e81dab37a7d0f69c524c396b1e074cd4489e34e3e16b5b4ac06c121fb35741413fc2aac704c50f40c80861', 'id': 'af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'created_at': datetime.datetime(2026, 6, 3, 13, 1, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 1, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af8f8b3a-5717-4ce1-8f64-b841fe95ec10/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Trying to clone 90116819-67d4-42d7-b6d2-e8912c445e74 from image af8f8b3a-5717-4ce1-8f64-b841fe95ec10 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'metadata': {}}]). {{(pid=86614) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 03 15:01:45 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Image download 0.00 MB at 0.00 MB/s Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[83148305-78cd-45b2-b3ea-5f54e3c9586f]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:45 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD Jun 03 15:01:45 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:46 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD" returned: 0 in 0.668s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:46 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD Jun 03 15:01:46 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:46 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD" returned: 1 in 0.643s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:01:46 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Temporary image af8f8b3a-5717-4ce1-8f64-b841fe95ec10 is fetched for user 8c9c97bea4234e1c94ab41da0930a686. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 03 15:01:46 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c25d877-2951-4467-afa4-79b5ecf5762e]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:47 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD Jun 03 15:01:47 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:47 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD" returned: 0 in 0.657s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:47 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:47 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD Jun 03 15:01:47 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:48 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD" returned: 1 in 0.645s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90116819-67d4-42d7-b6d2-e8912c445e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9ca1a7ae554c39a03d5eac34faab71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:01:45Z,use_quota=True,user_id='8c9c97bea4234e1c94ab41da0930a686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49301816-46bb-4299-9d16-e0266503675a),volume_type_id=49301816-46bb-4299-9d16-e0266503675a)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Creating volume 90116819-67d4-42d7-b6d2-e8912c445e74 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:01:48 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:48 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 1073741824 Jun 03 15:01:48 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:48 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 1073741824" returned: 0 in 0.743s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:49 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 Jun 03 15:01:49 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:49 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74" returned: 0 in 0.574s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:49 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:01:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:49 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Attempting download of af8f8b3a-5717-4ce1-8f64-b841fe95ec10 ((None, [{'url': 'file:///opt/stack/data/glance/images/af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'metadata': {}}])) to volume 90116819-67d4-42d7-b6d2-e8912c445e74. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 03 15:01:49 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[df96d390-063f-4893-9678-88561f2c354b]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_fx_2moal {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:49 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_fx_2moal Jun 03 15:01:49 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:50 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_fx_2moal" returned: 0 in 0.668s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_fx_2moal {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:50 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_fx_2moal Jun 03 15:01:50 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:50 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_fx_2moal" returned: 1 in 0.654s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_fx_2moal' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:01:50 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d229472-fb6a-462b-a654-4c3043cd736f]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:51 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD Jun 03 15:01:51 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:51 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD" returned: 0 in 0.677s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:51 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD Jun 03 15:01:51 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:52 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD" returned: 1 in 0.656s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:01:52 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] af8f8b3a-5717-4ce1-8f64-b841fe95ec10 was raw, converting to raw {{(pid=86614) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 03 15:01:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:52 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 Jun 03 15:01:52 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:52 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74" returned: 0 in 0.656s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:52 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af8f8b3a-5717-4ce1-8f64-b841fe95ec10_j07kadukdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 15:01:52 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Converted 0.00 MB image at 0.00 MB/s Jun 03 15:01:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:52 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 1G Jun 03 15:01:52 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:53 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 1G" returned: 0 in 0.619s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:53 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[017cd3f3-3a8c-46bb-8273-86f31f5016c8]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 15:01:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:53 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:01:53 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:53 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 Jun 03 15:01:53 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:54 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.592s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 15:01:54 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74" returned: 0 in 0.683s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:54 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 Jun 03 15:01:54 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:54 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74" returned: 1 in 0.664s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Downloaded image af8f8b3a-5717-4ce1-8f64-b841fe95ec10 ((None, [{'url': 'file:///opt/stack/data/glance/images/af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'metadata': {}}])) to volume 90116819-67d4-42d7-b6d2-e8912c445e74 successfully. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Temporary image af8f8b3a-5717-4ce1-8f64-b841fe95ec10 for user 8c9c97bea4234e1c94ab41da0930a686 is deleted. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Marking volume 90116819-67d4-42d7-b6d2-e8912c445e74 as bootable. {{(pid=86614) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Copying metadata from image af8f8b3a-5717-4ce1-8f64-b841fe95ec10 to 90116819-67d4-42d7-b6d2-e8912c445e74. {{(pid=86614) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 15:01:54 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Creating volume glance metadata for volume 90116819-67d4-42d7-b6d2-e8912c445e74 backed by image af8f8b3a-5717-4ce1-8f64-b841fe95ec10 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6b863a65eb3dff72af762498a193aed0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86614) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 15:01:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e5b118-b46d-406d-ae3b-075f68525be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90116819-67d4-42d7-b6d2-e8912c445e74', 'volume_size': 1, 'image_id': 'af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b863a65eb3dff72af762498a193aed0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d9ca1a7ae554c39a03d5eac34faab71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bcedf3bd9ab1c740cb768ff5cf6a8ebe51f0642b1e81dab37a7d0f69c524c396b1e074cd4489e34e3e16b5b4ac06c121fb35741413fc2aac704c50f40c80861', 'id': 'af8f8b3a-5717-4ce1-8f64-b841fe95ec10', 'created_at': datetime.datetime(2026, 6, 3, 13, 1, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 1, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af8f8b3a-5717-4ce1-8f64-b841fe95ec10/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60aa2bea-f45b-45d5-bec7-ef8627954054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:01:55 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Volume volume-90116819-67d4-42d7-b6d2-e8912c445e74 (90116819-67d4-42d7-b6d2-e8912c445e74): created successfully Jun 03 15:01:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60aa2bea-f45b-45d5-bec7-ef8627954054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:01:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Flow 'volume_create_manager' (1d36931a-3b6c-4e1f-b091-4d283396df64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:01:55 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-136958a5-c1e7-4ea1-a4a9-47df0b07d304 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Created volume successfully. Jun 03 15:01:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Acquiring lock "cinder-90116819-67d4-42d7-b6d2-e8912c445e74-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Lock "cinder-90116819-67d4-42d7-b6d2-e8912c445e74-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Acquiring lock "cinder-quobyte-90116819-67d4-42d7-b6d2-e8912c445e74" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:01:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Lock "cinder-quobyte-90116819-67d4-42d7-b6d2-e8912c445e74" acquired by "delete_volume" :: waited 0.013s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:01:55 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53a3404-becc-40c6-8ec1-838e572c6631]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:01:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:55 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 Jun 03 15:01:55 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:56 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74" returned: 0 in 0.670s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:56 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 Jun 03 15:01:56 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:57 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74" returned: 1 in 0.667s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:57 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74 Jun 03 15:01:57 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:57 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-90116819-67d4-42d7-b6d2-e8912c445e74" returned: 0 in 0.582s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Lock "cinder-quobyte-90116819-67d4-42d7-b6d2-e8912c445e74" released by "delete_volume" :: held 1.974s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:01:57 devstack cinder-volume[86614]: WARNING cinder.quota [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 03 15:01:57 devstack cinder-volume[86614]: WARNING cinder.quota [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Created reservations ['8b65ae9f-3a9e-4734-9eaf-2c2480c13cc1', 'bd1c4383-ba94-4868-9e5d-57565f8ce877', '3325d57c-906e-44a7-a33f-86016c072c7d', '5ab2f1e0-2ee8-4024-85b7-8928d04f4377'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:01:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:01:57 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:01:57 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:01:58 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jun 03 15:01:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.605s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:01:58 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:01:58 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Deleted volume successfully. Jun 03 15:01:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f2fef47a-9718-411f-8ff3-b1302d914804 tempest-VolumeAndVolumeTypeFromImageTest-396707332 None] Lock "cinder-90116819-67d4-42d7-b6d2-e8912c445e74-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (b7901969-7129-4fc6-b586-b1e2e72ed169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfff2445-96be-4539-9b78-37fab675ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfff2445-96be-4539-9b78-37fab675ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622660396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:02Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c34e13-a5e5-49fd-a255-bea0d6b306d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c34e13-a5e5-49fd-a255-bea0d6b306d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7166c531-8624-469c-9bef-e5f0f7dfec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7166c531-8624-469c-9bef-e5f0f7dfec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9', 'volume_name': 'volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805b7541-96a3-49f2-a058-918f4b56215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805b7541-96a3-49f2-a058-918f4b56215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c86a321-b3bc-4034-a2b7-9740f0d364d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:01 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9', 'volume_size': 1} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622660396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:02Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Creating volume ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:02:01 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:02:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:01 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 1073741824 Jun 03 15:02:01 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:02 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 1073741824" returned: 0 in 0.738s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:02 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 Jun 03 15:02:02 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:03 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9" returned: 0 in 0.582s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:03 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:02:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c86a321-b3bc-4034-a2b7-9740f0d364d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc19055-1816-42fb-a015-ec5fa1d37bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:03 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 (ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9): created successfully Jun 03 15:02:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc19055-1816-42fb-a015-ec5fa1d37bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (b7901969-7129-4fc6-b586-b1e2e72ed169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:03 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-334ecb87-1b31-4b2d-9e6c-f00aad51068d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created volume successfully. Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (c09dc88a-f889-480d-8d53-f559b63c4863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a43dab-e533-4f5a-9c9b-524a7716ab14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a43dab-e533-4f5a-9c9b-524a7716ab14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2113689437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3759ee8-3d27-415a-9191-c5924648c063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:04Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633c0d74-8e2c-4926-91eb-074b0169fee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633c0d74-8e2c-4926-91eb-074b0169fee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889e7bb7-f68d-41b9-a567-9e34c1b88cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889e7bb7-f68d-41b9-a567-9e34c1b88cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3759ee8-3d27-415a-9191-c5924648c063', 'volume_name': 'volume-d3759ee8-3d27-415a-9191-c5924648c063', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc51d06-d575-4999-8613-8da6208d5c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc51d06-d575-4999-8613-8da6208d5c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da0ece2-316d-4ec8-82f7-f4cba6e3580f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume d3759ee8-3d27-415a-9191-c5924648c063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3759ee8-3d27-415a-9191-c5924648c063', 'volume_size': 1} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2113689437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3759ee8-3d27-415a-9191-c5924648c063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:04Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Creating volume d3759ee8-3d27-415a-9191-c5924648c063 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:02:04 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:04 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063 1073741824 Jun 03 15:02:04 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (b282bf3d-7aa6-4234-9479-0a2d5d9ed711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a3bddb-0ddc-4134-9495-7db0a06b9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a3bddb-0ddc-4134-9495-7db0a06b9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-886967311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:04Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04334ce7-0eaa-47c2-9448-97f2b266f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04334ce7-0eaa-47c2-9448-97f2b266f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e293ee0-311f-47d5-9826-0b4958926a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e293ee0-311f-47d5-9826-0b4958926a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7', 'volume_name': 'volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c44c68e-d184-449a-a787-585a8fe8ece3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c44c68e-d184-449a-a787-585a8fe8ece3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0195def-98ef-4fd2-9b59-772f0fdd1906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7', 'volume_size': 1} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (6e0fba2a-6223-440c-985f-a1274dbd19d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5a39a8-e46e-4a81-8db8-86229cdbdcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5a39a8-e46e-4a81-8db8-86229cdbdcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305008562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:05Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8bbeb8-cf3b-4904-8a4c-dc8d6527c1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8bbeb8-cf3b-4904-8a4c-dc8d6527c1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de5a3e2-f03b-4e18-bf1f-fc7d2f1dc852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de5a3e2-f03b-4e18-bf1f-fc7d2f1dc852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d', 'volume_name': 'volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d47297-b723-48a4-b7ca-e83eeb7b2d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d47297-b723-48a4-b7ca-e83eeb7b2d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0243df56-e352-4aac-8fe3-7c84e2dfcb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:04 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d', 'volume_size': 1} Jun 03 15:02:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:05 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063 1073741824" returned: 0 in 0.878s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:02:05 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063 Jun 03 15:02:05 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (d3395865-9169-4ee3-8350-a3988a1b864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90995716-2a5c-4b91-b45f-40eba0608c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90995716-2a5c-4b91-b45f-40eba0608c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1850894221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7592e516-dee3-434e-89bc-9c1f405c9083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:05Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c044c07-bc54-43a6-a077-a886377deb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c044c07-bc54-43a6-a077-a886377deb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c1c9df-f2a6-47af-ab94-cefe4ffbec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c1c9df-f2a6-47af-ab94-cefe4ffbec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7592e516-dee3-434e-89bc-9c1f405c9083', 'volume_name': 'volume-7592e516-dee3-434e-89bc-9c1f405c9083', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30d0d34-1f40-42f9-b6d5-ca73f9c5a4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30d0d34-1f40-42f9-b6d5-ca73f9c5a4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32d0a63-330e-441b-88ad-9b7b715728cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume 7592e516-dee3-434e-89bc-9c1f405c9083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7592e516-dee3-434e-89bc-9c1f405c9083', 'volume_size': 1} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (0928d642-bfed-44eb-a45e-d7d449d10368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14eee171-a6ac-41b4-afbd-04ca215cc544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14eee171-a6ac-41b4-afbd-04ca215cc544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-135548243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391e3071-aca6-4548-a5d4-8408d53298cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:05Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9599fc4-8743-4e88-8370-1ff1c54bc80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9599fc4-8743-4e88-8370-1ff1c54bc80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de8faa8-2574-4a77-ac61-d1ab4d52d27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de8faa8-2574-4a77-ac61-d1ab4d52d27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '391e3071-aca6-4548-a5d4-8408d53298cb', 'volume_name': 'volume-391e3071-aca6-4548-a5d4-8408d53298cb', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cd71d8-d003-4593-a96f-4ea2fd2e24fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cd71d8-d003-4593-a96f-4ea2fd2e24fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7973f94a-48e0-45d1-aa6f-b5ced143793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume 391e3071-aca6-4548-a5d4-8408d53298cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-391e3071-aca6-4548-a5d4-8408d53298cb', 'volume_size': 1} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:05 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063" returned: 0 in 0.617s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-886967311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:04Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Creating volume c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:02:05 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da0ece2-316d-4ec8-82f7-f4cba6e3580f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3759ee8-3d27-415a-9191-c5924648c063', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:05 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 1073741824 Jun 03 15:02:05 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01752f3-030b-4b27-8d14-2c398b444b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:05 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume volume-d3759ee8-3d27-415a-9191-c5924648c063 (d3759ee8-3d27-415a-9191-c5924648c063): created successfully Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01752f3-030b-4b27-8d14-2c398b444b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (c09dc88a-f889-480d-8d53-f559b63c4863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:05 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b2629dd7-76fe-4e8f-8a73-6b546b9df756 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created volume successfully. Jun 03 15:02:06 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 1073741824" returned: 0 in 0.776s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:06 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 Jun 03 15:02:06 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:07 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7" returned: 0 in 0.577s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.236s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305008562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:05Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Creating volume e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:02:07 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0195def-98ef-4fd2-9b59-772f0fdd1906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ed6ef2-12d4-4c4a-9fce-f27d98e07fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:07 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d 1073741824 Jun 03 15:02:07 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:07 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 (c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7): created successfully Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ed6ef2-12d4-4c4a-9fce-f27d98e07fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (b282bf3d-7aa6-4234-9479-0a2d5d9ed711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:07 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-6a685bee-9569-4422-bedc-ca224bf77a9b tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created volume successfully. Jun 03 15:02:07 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d 1073741824" returned: 0 in 0.768s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:07 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d Jun 03 15:02:07 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:08 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d" returned: 0 in 0.616s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.350s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1850894221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7592e516-dee3-434e-89bc-9c1f405c9083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:05Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Creating volume 7592e516-dee3-434e-89bc-9c1f405c9083 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:02:08 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:08 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083 1073741824 Jun 03 15:02:08 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0243df56-e352-4aac-8fe3-7c84e2dfcb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4f0017-3c04-4ee7-bbc4-8273c019c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:08 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d (e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d): created successfully Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4f0017-3c04-4ee7-bbc4-8273c019c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (6e0fba2a-6223-440c-985f-a1274dbd19d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:08 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-6de208ed-65e9-460d-aa2d-50a1e97dd8a5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created volume successfully. Jun 03 15:02:09 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083 1073741824" returned: 0 in 0.764s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:09 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083 Jun 03 15:02:09 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:09 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083" returned: 0 in 0.568s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.373s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-135548243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391e3071-aca6-4548-a5d4-8408d53298cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a72770492444949afd813cc1de8a694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:05Z,use_quota=True,user_id='c82a581ec18f4fcfb292ce7a4dc46d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Creating volume 391e3071-aca6-4548-a5d4-8408d53298cb {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:02:09 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:02:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:10 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb 1073741824 Jun 03 15:02:10 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32d0a63-330e-441b-88ad-9b7b715728cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7592e516-dee3-434e-89bc-9c1f405c9083', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236886aa-ff30-4895-aa84-88d2eaa9f538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:10 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume volume-7592e516-dee3-434e-89bc-9c1f405c9083 (7592e516-dee3-434e-89bc-9c1f405c9083): created successfully Jun 03 15:02:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236886aa-ff30-4895-aa84-88d2eaa9f538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (d3395865-9169-4ee3-8350-a3988a1b864b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:10 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-83831a43-22d2-47ea-beab-fcebc53451dd tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created volume successfully. Jun 03 15:02:10 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb 1073741824" returned: 0 in 0.774s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:10 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb Jun 03 15:02:10 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:11 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb" returned: 0 in 0.584s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:02:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7973f94a-48e0-45d1-aa6f-b5ced143793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-391e3071-aca6-4548-a5d4-8408d53298cb', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3f704e-f02f-4463-bcc2-a773587ba071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:11 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Volume volume-391e3071-aca6-4548-a5d4-8408d53298cb (391e3071-aca6-4548-a5d4-8408d53298cb): created successfully Jun 03 15:02:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3f704e-f02f-4463-bcc2-a773587ba071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Flow 'volume_create_manager' (0928d642-bfed-44eb-a45e-d7d449d10368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:11 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-06a9963c-58d7-44c3-bd09-55a3795dadde tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created volume successfully. Jun 03 15:02:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-391e3071-aca6-4548-a5d4-8408d53298cb-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-391e3071-aca6-4548-a5d4-8408d53298cb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-quobyte-391e3071-aca6-4548-a5d4-8408d53298cb" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:12 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-391e3071-aca6-4548-a5d4-8408d53298cb" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:12 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f5c16a-8e2f-443c-b977-ea95122c648a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:12 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb Jun 03 15:02:12 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:12 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb" returned: 0 in 0.703s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:12 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb Jun 03 15:02:12 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:13 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-391e3071-aca6-4548-a5d4-8408d53298cb" returned: 0 in 0.596s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-391e3071-aca6-4548-a5d4-8408d53298cb" released by "delete_volume" :: held 1.338s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:13 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created reservations ['a2e086fd-30bc-4ec6-abde-43b5e0a606e6', 'd6ac03a0-a7d8-435c-88d6-5ae1a3760f27', '16769f55-7c27-400f-8385-af295ec071bd', '4fef1c2d-b2c4-44cb-b5de-f04b7ede8884'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:02:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:13 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:02:13 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:14 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.582s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:14 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:02:14 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Deleted volume successfully. Jun 03 15:02:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-315e2d9a-c0b3-4630-83ec-2348f0a807f5 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-391e3071-aca6-4548-a5d4-8408d53298cb-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-7592e516-dee3-434e-89bc-9c1f405c9083-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-7592e516-dee3-434e-89bc-9c1f405c9083-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-quobyte-7592e516-dee3-434e-89bc-9c1f405c9083" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:14 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-7592e516-dee3-434e-89bc-9c1f405c9083" acquired by "delete_volume" :: waited 0.017s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:14 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8cfaaa-497f-4f0c-858d-b927136cd67d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:14 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083 Jun 03 15:02:14 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:15 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083" returned: 0 in 0.682s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:15 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083 Jun 03 15:02:15 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:15 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7592e516-dee3-434e-89bc-9c1f405c9083" returned: 0 in 0.599s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-7592e516-dee3-434e-89bc-9c1f405c9083" released by "delete_volume" :: held 1.320s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created reservations ['94971f94-0df2-4c22-8b0c-fce48ff9fda7', 'dda3f7f1-f7b6-492e-b0b5-df169c8e1b24', '96f26f67-1961-46ea-ac71-a24d42a070f5', 'cff080ed-ce1f-46c5-b00f-a24789182d0b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:15 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:02:15 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:16 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.575s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:16 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:02:16 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Deleted volume successfully. Jun 03 15:02:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-0f806bc0-120a-4944-8e3a-27dce494131d tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-7592e516-dee3-434e-89bc-9c1f405c9083-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-quobyte-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:16 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dae97f-427b-4320-89c0-c75af40b6db4]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:16 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d Jun 03 15:02:16 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:17 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d" returned: 0 in 0.685s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:17 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d Jun 03 15:02:17 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:17 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d" returned: 0 in 0.606s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d" released by "delete_volume" :: held 1.328s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:17 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created reservations ['1ab326eb-5508-4303-a1ec-6295fb365c25', '6a58e949-d6d5-4d34-810d-ae9d0c8a08fe', 'd9ffdc2b-386e-4dfb-bb6e-78aef8610d24', '6bc59e4c-5d12-4c79-b798-e53f181d20a0'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:18 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:02:18 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:18 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.563s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:02:18 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Deleted volume successfully. Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d19dcd33-f016-4359-9cc6-1c4ad691a25c tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-e0f5e5fb-39ee-4cad-9dbf-61ab5b81dc4d-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-quobyte-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[af75ab0c-f5ff-4aa1-a403-eacd1f14b071]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:18 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 Jun 03 15:02:18 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:19 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7" returned: 0 in 0.683s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:19 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7 Jun 03 15:02:19 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:20 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7" returned: 0 in 0.578s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7" released by "delete_volume" :: held 1.300s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created reservations ['4a9af498-8471-4eca-9552-0abe11215783', '362ea162-ba1f-4bbd-94d4-46136fb86b8e', 'b9f14282-eeae-4485-9235-27da58fd3589', 'd45a0db4-164e-463a-9c19-44a6fcf9f2c9'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:20 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:02:20 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:20 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.599s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:02:20 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Deleted volume successfully. Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-52e67cc8-b60c-4c78-9020-8ff7e4be6425 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-c5d96d1d-3bbe-44a3-b672-b6e5ec489ea7-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-d3759ee8-3d27-415a-9191-c5924648c063-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-d3759ee8-3d27-415a-9191-c5924648c063-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-quobyte-d3759ee8-3d27-415a-9191-c5924648c063" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-d3759ee8-3d27-415a-9191-c5924648c063" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:21 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3458350-2eee-4484-9f29-b5178640a158]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:21 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063 Jun 03 15:02:21 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:21 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063" returned: 0 in 0.698s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:21 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063 Jun 03 15:02:21 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:22 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d3759ee8-3d27-415a-9191-c5924648c063" returned: 0 in 0.587s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-d3759ee8-3d27-415a-9191-c5924648c063" released by "delete_volume" :: held 1.322s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created reservations ['26bdb267-c6c4-4f8c-9996-4c7b169d54a6', 'f203e524-869f-481d-bd8e-9b718d040172', '1cf8a621-a5fc-4a7b-9f52-701c61f78cee', '05dc8f74-e4d5-4eb5-bd5f-8b12dcae409c'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:22 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:02:22 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:22 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.579s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:22 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:02:23 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Deleted volume successfully. Jun 03 15:02:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-03fcaaa6-829a-469e-9deb-6f8da4cdc026 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-d3759ee8-3d27-415a-9191-c5924648c063-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "cinder-quobyte-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:23 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a5f86-f444-4346-b244-e1439baf93e9]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:23 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 Jun 03 15:02:23 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:23 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9" returned: 0 in 0.682s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:23 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9 Jun 03 15:02:23 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:24 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9" returned: 0 in 0.585s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-quobyte-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9" released by "delete_volume" :: held 1.305s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:24 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Created reservations ['4c68cc80-5123-4e59-8c09-3a362dd19449', '7b82b815-5687-466b-b85a-e75f6a1fb7b1', '6b3b704c-859f-48d6-9592-3db5b5755957', '50552f74-6c20-45d0-8a39-e4708a7bc8a8'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:02:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:24 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:24 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:02:24 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:25 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.578s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:25 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:02:25 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Deleted volume successfully. Jun 03 15:02:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9660211-93b1-446d-87ba-9d480bf824c7 tempest-CreateVolumesFromSourceVolumeTest-2137250336 None] Lock "cinder-ebfdd85b-35a3-40f7-b8f0-cf4d1fa014f9-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Flow 'volume_create_manager' (f7ef885e-9076-412a-9c1e-3f39b03c4b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404c57d0-2572-41cf-b7d9-7fa212de6237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404c57d0-2572-41cf-b7d9-7fa212de6237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23585b0-0d73-454a-a92b-c6062fa93cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7aeae80b0a4b4a8537acbad2ae4980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:30Z,use_quota=True,user_id='ced0d9792da74edcb86074cb8fcb4303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2819973b-4d9b-4546-8df7-8a3c15ec460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2819973b-4d9b-4546-8df7-8a3c15ec460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac048ca-425d-45f0-bbca-82c25cc71160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.image.glance [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Creating Keystone auth plugin from conf {{(pid=86614) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac048ca-425d-45f0-bbca-82c25cc71160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a23585b0-0d73-454a-a92b-c6062fa93cea', 'volume_name': 'volume-a23585b0-0d73-454a-a92b-c6062fa93cea', 'volume_size': 1, 'image_id': 'e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1bef330569def113f0a0371668d6f957', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe7aeae80b0a4b4a8537acbad2ae4980', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd473cc0ef3c1f6fb479a77860f816ebc790b09f6e6b4722b89ffe5feda2c4f7676617dba5e5f18976071ba1f8c5f199e24308cceb47c4238084a3f18d370793e', 'id': 'e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'created_at': datetime.datetime(2026, 6, 3, 13, 2, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 2, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5a2f5bf-f903-4b4b-be85-5ed49cda5d13/file', 'properties': {}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2990a7a6-d3bf-4ae2-b25a-f69f6cd4a0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2990a7a6-d3bf-4ae2-b25a-f69f6cd4a0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b349adf-6c29-4b2f-a5fe-fba693d36c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:29 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Volume a23585b0-0d73-454a-a92b-c6062fa93cea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a23585b0-0d73-454a-a92b-c6062fa93cea', 'volume_size': 1, 'image_id': 'e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1bef330569def113f0a0371668d6f957', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe7aeae80b0a4b4a8537acbad2ae4980', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd473cc0ef3c1f6fb479a77860f816ebc790b09f6e6b4722b89ffe5feda2c4f7676617dba5e5f18976071ba1f8c5f199e24308cceb47c4238084a3f18d370793e', 'id': 'e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'created_at': datetime.datetime(2026, 6, 3, 13, 2, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 2, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5a2f5bf-f903-4b4b-be85-5ed49cda5d13/file', 'properties': {}}, 'image_service': } Jun 03 15:02:29 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Trying to clone a23585b0-0d73-454a-a92b-c6062fa93cea from image e5a2f5bf-f903-4b4b-be85-5ed49cda5d13 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'metadata': {}}]). {{(pid=86614) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 03 15:02:30 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 03 15:02:30 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Image download 0.00 MB at 0.00 MB/s Jun 03 15:02:30 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b5f662-adce-4a31-815b-d319c957ef85]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:30 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD Jun 03 15:02:30 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:30 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD" returned: 0 in 0.671s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:30 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD Jun 03 15:02:30 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:31 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD" returned: 1 in 0.655s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:02:31 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Temporary image e5a2f5bf-f903-4b4b-be85-5ed49cda5d13 is fetched for user ced0d9792da74edcb86074cb8fcb4303. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 03 15:02:31 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a7e950-bdc3-4721-8164-3e5d684873b6]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:31 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD Jun 03 15:02:31 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:32 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:32 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD Jun 03 15:02:32 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:32 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD" returned: 1 in 0.635s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23585b0-0d73-454a-a92b-c6062fa93cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7aeae80b0a4b4a8537acbad2ae4980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:30Z,use_quota=True,user_id='ced0d9792da74edcb86074cb8fcb4303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Creating volume a23585b0-0d73-454a-a92b-c6062fa93cea {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:02:32 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:02:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:32 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea 1073741824 Jun 03 15:02:32 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:33 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea 1073741824" returned: 0 in 0.725s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:33 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea Jun 03 15:02:33 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:34 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea" returned: 0 in 0.570s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:34 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:02:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:34 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Attempting download of e5a2f5bf-f903-4b4b-be85-5ed49cda5d13 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'metadata': {}}])) to volume a23585b0-0d73-454a-a92b-c6062fa93cea. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 03 15:02:34 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c4a5f3-2998-4ee6-bc3e-7e9918747a3a]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_osfw3hr5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:34 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_osfw3hr5 Jun 03 15:02:34 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:34 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_osfw3hr5" returned: 0 in 0.663s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_osfw3hr5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:34 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_osfw3hr5 Jun 03 15:02:34 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:35 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_osfw3hr5" returned: 1 in 0.640s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_osfw3hr5' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:02:35 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[3397ef9a-4675-4fc8-bc7b-4883b26af909]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:35 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD Jun 03 15:02:35 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:36 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD" returned: 0 in 0.641s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:36 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD Jun 03 15:02:36 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:36 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD" returned: 1 in 0.652s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:02:36 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] e5a2f5bf-f903-4b4b-be85-5ed49cda5d13 was raw, converting to raw {{(pid=86614) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 03 15:02:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:36 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea Jun 03 15:02:36 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:37 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea" returned: 0 in 0.646s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:37 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5a2f5bf-f903-4b4b-be85-5ed49cda5d13_yo2v7_mqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 15:02:37 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Converted 0.00 MB image at 0.00 MB/s Jun 03 15:02:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:37 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea 1G Jun 03 15:02:37 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:38 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea 1G" returned: 0 in 0.627s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:38 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fc1013-e695-48d1-a8d2-bd25812726cd]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:38 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea Jun 03 15:02:38 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:38 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea" returned: 0 in 0.682s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:38 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea Jun 03 15:02:38 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:39 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea" returned: 1 in 0.678s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Downloaded image e5a2f5bf-f903-4b4b-be85-5ed49cda5d13 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'metadata': {}}])) to volume a23585b0-0d73-454a-a92b-c6062fa93cea successfully. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Temporary image e5a2f5bf-f903-4b4b-be85-5ed49cda5d13 for user ced0d9792da74edcb86074cb8fcb4303 is deleted. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Marking volume a23585b0-0d73-454a-a92b-c6062fa93cea as bootable. {{(pid=86614) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Copying metadata from image e5a2f5bf-f903-4b4b-be85-5ed49cda5d13 to a23585b0-0d73-454a-a92b-c6062fa93cea. {{(pid=86614) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Creating volume glance metadata for volume a23585b0-0d73-454a-a92b-c6062fa93cea backed by image e5a2f5bf-f903-4b4b-be85-5ed49cda5d13 with: {'image_id': 'e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1bef330569def113f0a0371668d6f957', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86614) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b349adf-6c29-4b2f-a5fe-fba693d36c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23585b0-0d73-454a-a92b-c6062fa93cea', 'volume_size': 1, 'image_id': 'e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1bef330569def113f0a0371668d6f957', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe7aeae80b0a4b4a8537acbad2ae4980', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd473cc0ef3c1f6fb479a77860f816ebc790b09f6e6b4722b89ffe5feda2c4f7676617dba5e5f18976071ba1f8c5f199e24308cceb47c4238084a3f18d370793e', 'id': 'e5a2f5bf-f903-4b4b-be85-5ed49cda5d13', 'created_at': datetime.datetime(2026, 6, 3, 13, 2, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 2, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5a2f5bf-f903-4b4b-be85-5ed49cda5d13/file', 'properties': {}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2c1c17-05a3-41b6-9585-c4047bf20625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:39 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Volume volume-a23585b0-0d73-454a-a92b-c6062fa93cea (a23585b0-0d73-454a-a92b-c6062fa93cea): created successfully Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2c1c17-05a3-41b6-9585-c4047bf20625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:39 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Flow 'volume_create_manager' (f7ef885e-9076-412a-9c1e-3f39b03c4b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:39 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-88829b8e-4433-434b-9ad1-e29d07f2674d tempest-VolumeImageDependencyTests-70768299 None] Created volume successfully. Jun 03 15:02:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Acquiring lock "cinder-a23585b0-0d73-454a-a92b-c6062fa93cea-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Lock "cinder-a23585b0-0d73-454a-a92b-c6062fa93cea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Acquiring lock "cinder-quobyte-a23585b0-0d73-454a-a92b-c6062fa93cea" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:02:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Lock "cinder-quobyte-a23585b0-0d73-454a-a92b-c6062fa93cea" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:02:40 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b35c8ac-b82a-4130-8ee4-0bc195127bc3]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:40 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea Jun 03 15:02:40 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:41 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea" returned: 0 in 0.686s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:41 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea Jun 03 15:02:41 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:41 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea" returned: 1 in 0.669s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:02:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:41 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea Jun 03 15:02:41 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:42 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a23585b0-0d73-454a-a92b-c6062fa93cea" returned: 0 in 0.577s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Lock "cinder-quobyte-a23585b0-0d73-454a-a92b-c6062fa93cea" released by "delete_volume" :: held 1.989s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:42 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Created reservations ['aeb01643-1a0c-483e-a983-1dd4d7e6f82c', '44125c04-13df-44dd-aee5-b07b83efb118', 'f76e75d4-57aa-473f-90ff-05f74612c0bc', '2388d135-5c93-49ae-ae0c-50ccbd9384b6'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:02:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:42 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:02:42 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:43 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.607s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:43 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:02:43 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Deleted volume successfully. Jun 03 15:02:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8841b5dd-91e0-485b-b163-c0fea390fd1d tempest-VolumeImageDependencyTests-70768299 None] Lock "cinder-a23585b0-0d73-454a-a92b-c6062fa93cea-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:02:52 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=67,cinder:UPDATE=98,cinder:INSERT=30,cinder:DELETE=2 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:02:53 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=85,cinder:SELECT=69,cinder:INSERT=29,cinder:DELETE=14 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:02:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 15:02:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 15:02:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (422aa2b7-3e72-47e6-9fdc-ae1be2680985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf0f501-057b-4166-8511-4c34e3aade91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf0f501-057b-4166-8511-4c34e3aade91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767482819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef56aa0-0141-41a0-84ca-d238cfccd1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:54Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45aa8ad9-6049-4696-84a9-ee1c1798ae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45aa8ad9-6049-4696-84a9-ee1c1798ae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8c7e32-6c12-4e8d-8efb-7bcd2a9df5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8c7e32-6c12-4e8d-8efb-7bcd2a9df5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef56aa0-0141-41a0-84ca-d238cfccd1ea', 'volume_name': 'volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406e2599-1899-4518-986d-ca0bd77fbfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406e2599-1899-4518-986d-ca0bd77fbfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c49b62-23b4-48b1-a01c-81c35b0a4d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:54 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume 2ef56aa0-0141-41a0-84ca-d238cfccd1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea', 'volume_size': 1} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767482819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef56aa0-0141-41a0-84ca-d238cfccd1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:54Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Creating volume 2ef56aa0-0141-41a0-84ca-d238cfccd1ea {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:02:54 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:02:54 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea 1073741824 Jun 03 15:02:54 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Flow 'volume_create_manager' (d6fa41b5-6202-46e9-9932-2ea84cbf4148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c11ebf-d1ff-4215-b9f8-efc612b53ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c11ebf-d1ff-4215-b9f8-efc612b53ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-515984816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63d2666-e12a-4555-b70a-ab14f4ad0b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea69347dc9a49a7a65d162d7cc5dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:54Z,use_quota=True,user_id='a69a64b4f38440b7a9f6de4e42c1794f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c24e27-7943-46f5-a21f-66adb12f470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c24e27-7943-46f5-a21f-66adb12f470a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ef1fdb-05fd-4edd-8e6a-06b7d3c11485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ef1fdb-05fd-4edd-8e6a-06b7d3c11485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63d2666-e12a-4555-b70a-ab14f4ad0b72', 'volume_name': 'volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9ece78-1c30-4967-ace0-fb543f96eca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9ece78-1c30-4967-ace0-fb543f96eca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444d7864-e45c-4a40-8c1f-aa1ba8720415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:54 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Volume b63d2666-e12a-4555-b70a-ab14f4ad0b72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72', 'volume_size': 1} Jun 03 15:02:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:55 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea 1073741824" returned: 0 in 0.922s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:55 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea Jun 03 15:02:55 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:55 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" returned: 0 in 0.603s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-515984816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63d2666-e12a-4555-b70a-ab14f4ad0b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea69347dc9a49a7a65d162d7cc5dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:54Z,use_quota=True,user_id='a69a64b4f38440b7a9f6de4e42c1794f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Creating volume b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:02:55 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c49b62-23b4-48b1-a01c-81c35b0a4d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:55 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 1073741824 Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56a0272-dc49-4748-92bf-ea229034bfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:55 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:55 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea (2ef56aa0-0141-41a0-84ca-d238cfccd1ea): created successfully Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56a0272-dc49-4748-92bf-ea229034bfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:55 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (422aa2b7-3e72-47e6-9fdc-ae1be2680985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e75b2126-23c6-40c2-a9af-32aa3e4d33f3 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created volume successfully. Jun 03 15:02:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:56 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 1073741824" returned: 0 in 0.944s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:56 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 Jun 03 15:02:56 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:57 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72" returned: 0 in 0.692s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.073s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444d7864-e45c-4a40-8c1f-aa1ba8720415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691e5a2e-a904-49f7-8500-a73f60de9511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Creating offline snapshot e4afaa24-c35d-41b6-852b-6fe557cadabe of volume 2ef56aa0-0141-41a0-84ca-d238cfccd1ea {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 15:02:57 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Volume volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 (b63d2666-e12a-4555-b70a-ab14f4ad0b72): created successfully Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691e5a2e-a904-49f7-8500-a73f60de9511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Flow 'volume_create_manager' (d6fa41b5-6202-46e9-9932-2ea84cbf4148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[50022bcc-e636-460a-b2a6-c8bf78a51734]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:57 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-cd454a47-4086-4327-8dd0-ce1be22a043c tempest-VolumeDependencyTests-1322162741 None] Created volume successfully. Jun 03 15:02:57 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea Jun 03 15:02:57 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Flow 'volume_create_manager' (44afb6c2-0da6-4731-ab8c-cf7d80a49eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ae56d7-2fea-48d5-8194-1ff810ccdd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ae56d7-2fea-48d5-8194-1ff810ccdd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f36772e-55f1-4aba-a7c6-81d979ab78bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06cda487b6444aaa1d25a35a4d09442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:58Z,use_quota=True,user_id='bea6caa6a27b49ebbc2eebf0a67f9f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94f7a2f6-60ac-43bd-b290-2647a11fd453),volume_type_id=94f7a2f6-60ac-43bd-b290-2647a11fd453)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e5682f-6b0a-452f-9f00-55f9512224bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e5682f-6b0a-452f-9f00-55f9512224bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9a88bd-d1b3-49e0-b2fe-9fef04d413e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.image.glance [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Creating Keystone auth plugin from conf {{(pid=86614) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 15:02:58 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" returned: 0 in 0.763s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:58 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe 1G Jun 03 15:02:58 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9a88bd-d1b3-49e0-b2fe-9fef04d413e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f36772e-55f1-4aba-a7c6-81d979ab78bf', 'volume_name': 'volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf', 'volume_size': 1, 'image_id': '0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12ea0d3bd969598a8c085c7a2c2210f3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b06cda487b6444aaa1d25a35a4d09442', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c5968e62001dd607dc69d74ea225a949de00d23f0da129651b61e00319fd9f6678f7efb5a2072ca9eead9b0f17d6ab061f95bbc24436d3ea648df12553dee2b4', 'id': '0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'created_at': datetime.datetime(2026, 6, 3, 13, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 2, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b9928f5-d4ec-45cc-8d04-0662ec6cce2c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1703ef-41b7-46c3-89c2-5f428e56c38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1703ef-41b7-46c3-89c2-5f428e56c38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6665285f-0930-4bcc-8f98-2e7f16f34c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:02:58 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Volume 8f36772e-55f1-4aba-a7c6-81d979ab78bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf', 'volume_size': 1, 'image_id': '0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12ea0d3bd969598a8c085c7a2c2210f3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b06cda487b6444aaa1d25a35a4d09442', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c5968e62001dd607dc69d74ea225a949de00d23f0da129651b61e00319fd9f6678f7efb5a2072ca9eead9b0f17d6ab061f95bbc24436d3ea648df12553dee2b4', 'id': '0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'created_at': datetime.datetime(2026, 6, 3, 13, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 2, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b9928f5-d4ec-45cc-8d04-0662ec6cce2c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Trying to clone 8f36772e-55f1-4aba-a7c6-81d979ab78bf from image 0b9928f5-d4ec-45cc-8d04-0662ec6cce2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'metadata': {}}]). {{(pid=86614) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 03 15:02:58 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Image download 0.00 MB at 0.00 MB/s Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[28687522-b72a-482d-a8b1-e4442f30ff9a]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:02:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:58 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD Jun 03 15:02:58 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:59 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe 1G" returned: 0 in 0.868s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:59 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe Jun 03 15:02:59 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:02:59 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jun 03 15:02:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:02:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:02:59 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD Jun 03 15:02:59 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:00 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe" returned: 0 in 0.829s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:00 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe is being set with open permissions: ugo+rw Jun 03 15:03:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:00 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe Jun 03 15:03:00 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:00 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD" returned: 1 in 0.804s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:03:00 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Temporary image 0b9928f5-d4ec-45cc-8d04-0662ec6cce2c is fetched for user bea6caa6a27b49ebbc2eebf0a67f9f05. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 03 15:03:00 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dc7943-ffb0-4c86-9bff-16540ebb6e36]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:00 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD Jun 03 15:03:00 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:00 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe" returned: 0 in 0.774s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:01 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.info Jun 03 15:03:01 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:01 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD" returned: 0 in 0.784s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:01 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD Jun 03 15:03:01 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:01 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.info" returned: 0 in 0.759s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:01 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.info is being set with open permissions: ugo+rw Jun 03 15:03:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:01 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.info Jun 03 15:03:01 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:02 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD" returned: 1 in 0.843s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:03:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:02 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.info" returned: 0 in 0.648s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.800s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.657s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:02 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Creating offline snapshot b25ba948-b962-43bd-b79a-b205fa17480e of volume b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 15:03:02 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4c883167-d9a6-4276-85a5-5137164dfeb2 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Create snapshot completed successfully Jun 03 15:03:02 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[275cdf9e-a25a-440c-9737-b06e76384513]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:02 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 Jun 03 15:03:02 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:03 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72" returned: 0 in 0.823s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:03 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e 1G Jun 03 15:03:03 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (8b0801fb-9965-4d56-b6be-60f5bcf6152b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069939bb-de17-4f5b-b8a2-f56e0d4dfe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069939bb-de17-4f5b-b8a2-f56e0d4dfe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002682435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd3c8e1-4e23-4890-9d66-b9dbb182c176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:03Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfb6b50-bcac-4196-af0f-b90f4e17b30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfb6b50-bcac-4196-af0f-b90f4e17b30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98356acb-bdc8-4cd1-b56d-37c6d8b389e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98356acb-bdc8-4cd1-b56d-37c6d8b389e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd3c8e1-4e23-4890-9d66-b9dbb182c176', 'volume_name': 'volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4862c6ab-d7e3-407f-8d0a-49507c52f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4862c6ab-d7e3-407f-8d0a-49507c52f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccc50b3-e32f-4c6b-9b8d-f0a8b581b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:03 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume fcd3c8e1-4e23-4890-9d66-b9dbb182c176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176', 'volume_size': 1} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (dddfed67-9b57-4a97-b02d-6c8b72299e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a7a68a-0928-44c3-8b64-0b83670e3907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a7a68a-0928-44c3-8b64-0b83670e3907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1463661947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680666b3-2d9a-477f-8b7e-e6dad8abbc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:04Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b4a91b-ae9d-4490-886e-4cbe72187d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b4a91b-ae9d-4490-886e-4cbe72187d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902651c1-65a7-4d26-837a-8c047ea5ac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902651c1-65a7-4d26-837a-8c047ea5ac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680666b3-2d9a-477f-8b7e-e6dad8abbc11', 'volume_name': 'volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1011fc65-9e85-4ef6-8b18-acdd8123d4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1011fc65-9e85-4ef6-8b18-acdd8123d4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b8ae36-7039-463a-9653-96a0293da638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:03 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume 680666b3-2d9a-477f-8b7e-e6dad8abbc11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11', 'volume_size': 1} Jun 03 15:03:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (9bfd2ce9-ed61-4844-a602-7b71e324f883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:04 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0ac809-ece6-4441-b617-edb04736b97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e 1G" returned: 0 in 1.037s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0ac809-ece6-4441-b617-edb04736b97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20505790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ce7935-b614-4d86-a344-5e848e31f84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:04Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:04 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e Jun 03 15:03:04 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78971461-2407-4685-962b-5561d9b209b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78971461-2407-4685-962b-5561d9b209b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e08c369-1d7c-4970-8a38-67138237932e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e08c369-1d7c-4970-8a38-67138237932e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ce7935-b614-4d86-a344-5e848e31f84a', 'volume_name': 'volume-26ce7935-b614-4d86-a344-5e848e31f84a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fa7af7-74e7-4eef-9fd0-d15ce7dd7789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fa7af7-74e7-4eef-9fd0-d15ce7dd7789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db68dae1-678f-4a58-ba66-3a99cc830267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:04 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume 26ce7935-b614-4d86-a344-5e848e31f84a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ce7935-b614-4d86-a344-5e848e31f84a', 'volume_size': 1} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (5ce222ad-cdbd-4675-9b75-4d5e9af774eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3f2477-c45d-44d6-b87c-2f50db55b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3f2477-c45d-44d6-b87c-2f50db55b14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1748316000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a80d34f-8c08-4c99-8100-1ad3479a54a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:05Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677c572a-c17f-4cd9-80af-075c2337fdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677c572a-c17f-4cd9-80af-075c2337fdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef46e480-8482-481f-a548-d609201de026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef46e480-8482-481f-a548-d609201de026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a80d34f-8c08-4c99-8100-1ad3479a54a3', 'volume_name': 'volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ea61fe-5833-4580-bbae-85bdba4e398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ea61fe-5833-4580-bbae-85bdba4e398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:04 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9185d8-56e2-44d2-b4fd-145004b9ec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:04 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume 9a80d34f-8c08-4c99-8100-1ad3479a54a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3', 'volume_size': 1} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:05 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e" returned: 0 in 0.857s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:05 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e is being set with open permissions: ugo+rw Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:05 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e Jun 03 15:03:05 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (a6ff1f2b-2c0a-49c5-8c24-7b3d2f5e6c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb8e1e4-9c88-4dc1-ae2a-550f0c28ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb8e1e4-9c88-4dc1-ae2a-550f0c28ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1483999868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2b52a5-cf7f-4d91-9355-69c3027199e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:05Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346a2907-9be0-4ca6-a72f-11f4004b35a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346a2907-9be0-4ca6-a72f-11f4004b35a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7efa6e62-15f9-4546-9d15-713ead2ee03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7efa6e62-15f9-4546-9d15-713ead2ee03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2b52a5-cf7f-4d91-9355-69c3027199e7', 'volume_name': 'volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbb0404-cbc7-4cb6-bf80-7c848a47c2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbb0404-cbc7-4cb6-bf80-7c848a47c2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e95e71-3590-4f3d-bc92-eae864c7cbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:05 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume ef2b52a5-cf7f-4d91-9355-69c3027199e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7', 'volume_size': 1} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:05 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e" returned: 0 in 0.629s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:05 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.info Jun 03 15:03:05 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:06 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.info" returned: 0 in 0.600s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:06 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.info is being set with open permissions: ugo+rw Jun 03 15:03:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:06 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.info Jun 03 15:03:06 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:07 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.info" returned: 0 in 0.598s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.646s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.937s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f36772e-55f1-4aba-a7c6-81d979ab78bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06cda487b6444aaa1d25a35a4d09442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:02:58Z,use_quota=True,user_id='bea6caa6a27b49ebbc2eebf0a67f9f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94f7a2f6-60ac-43bd-b290-2647a11fd453),volume_type_id=94f7a2f6-60ac-43bd-b290-2647a11fd453)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Creating volume 8f36772e-55f1-4aba-a7c6-81d979ab78bf {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:07 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:07 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf 1073741824 Jun 03 15:03:07 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:07 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b6403bbd-568b-433c-acd7-f8e2d6aa3fa3 tempest-VolumeDependencyTests-1322162741 None] Create snapshot completed successfully Jun 03 15:03:07 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf 1073741824" returned: 0 in 0.807s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:07 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf Jun 03 15:03:07 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:08 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf" returned: 0 in 0.692s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.125s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002682435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd3c8e1-4e23-4890-9d66-b9dbb182c176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:03Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Creating volume fcd3c8e1-4e23-4890-9d66-b9dbb182c176 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:08 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:08 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176 1073741824 Jun 03 15:03:08 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Attempting download of 0b9928f5-d4ec-45cc-8d04-0662ec6cce2c ((None, [{'url': 'file:///opt/stack/data/glance/images/0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'metadata': {}}])) to volume 8f36772e-55f1-4aba-a7c6-81d979ab78bf. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[546ac6d1-205d-4161-bd0f-d03876689925]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_apm1qrpz {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:08 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_apm1qrpz Jun 03 15:03:08 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:08 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Flow 'volume_create_manager' (20a4e9fa-4ab6-4d34-98c2-21c721ec43a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02aca543-7a24-43d4-b182-d53ef5208264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02aca543-7a24-43d4-b182-d53ef5208264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1648606123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22dc4045-5e94-46d6-a175-18a7d56d3a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea69347dc9a49a7a65d162d7cc5dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b25ba948-b962-43bd-b79a-b205fa17480e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:09Z,use_quota=True,user_id='a69a64b4f38440b7a9f6de4e42c1794f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5160d6-0ef0-4a2c-aae8-85795713d152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5160d6-0ef0-4a2c-aae8-85795713d152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8d49f6-1187-4513-8299-bf17d52c88eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8d49f6-1187-4513-8299-bf17d52c88eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '22dc4045-5e94-46d6-a175-18a7d56d3a0c', 'volume_name': 'volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c', 'volume_size': 1, 'snapshot_id': 'b25ba948-b962-43bd-b79a-b205fa17480e'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e5a7ac-a538-4e70-aef9-191dbb677b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e5a7ac-a538-4e70-aef9-191dbb677b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48b4a97-7573-477e-880c-89de3090d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:09 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Volume 22dc4045-5e94-46d6-a175-18a7d56d3a0c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c', 'volume_size': 1, 'snapshot_id': 'b25ba948-b962-43bd-b79a-b205fa17480e'} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:09 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176 1073741824" returned: 0 in 0.986s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:09 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_apm1qrpz" returned: 0 in 0.929s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_apm1qrpz {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:09 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176 Jun 03 15:03:09 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:09 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_apm1qrpz Jun 03 15:03:09 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:10 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176" returned: 0 in 0.586s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.307s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1463661947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680666b3-2d9a-477f-8b7e-e6dad8abbc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:04Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Creating volume 680666b3-2d9a-477f-8b7e-e6dad8abbc11 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:10 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccc50b3-e32f-4c6b-9b8d-f0a8b581b60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8454fa-b726-437e-905c-06e112a9f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:10 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11 1073741824 Jun 03 15:03:10 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:10 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176 (fcd3c8e1-4e23-4890-9d66-b9dbb182c176): created successfully Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8454fa-b726-437e-905c-06e112a9f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (8b0801fb-9965-4d56-b6be-60f5bcf6152b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:10 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b17221db-fb84-4426-be89-80da1f838bca tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created volume successfully. Jun 03 15:03:10 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_apm1qrpz" returned: 1 in 0.738s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_apm1qrpz' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[632a2495-ae3b-40fa-9c16-de1c77b154f9]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:10 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD Jun 03 15:03:10 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:11 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11 1073741824" returned: 0 in 0.856s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:11 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD" returned: 0 in 0.726s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:11 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11 Jun 03 15:03:11 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:11 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD Jun 03 15:03:11 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:11 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11" returned: 0 in 0.687s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.433s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20505790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ce7935-b614-4d86-a344-5e848e31f84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:04Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Creating volume 26ce7935-b614-4d86-a344-5e848e31f84a {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:11 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:11 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD" returned: 1 in 0.759s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] 0b9928f5-d4ec-45cc-8d04-0662ec6cce2c was raw, converting to raw {{(pid=86614) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 03 15:03:11 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a 1073741824 Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:11 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b8ae36-7039-463a-9653-96a0293da638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:11 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e27c4fa-7503-461f-a21c-1405574f474a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:11 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf Jun 03 15:03:11 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:11 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11 (680666b3-2d9a-477f-8b7e-e6dad8abbc11): created successfully Jun 03 15:03:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e27c4fa-7503-461f-a21c-1405574f474a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:12 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (dddfed67-9b57-4a97-b02d-6c8b72299e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:12 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8e9679fc-3362-4865-b9fa-714a4bcb010f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created volume successfully. Jun 03 15:03:12 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a 1073741824" returned: 0 in 0.862s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:12 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf" returned: 0 in 0.855s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:12 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0b9928f5-d4ec-45cc-8d04-0662ec6cce2c_std0i60vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 15:03:12 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Converted 0.00 MB image at 0.00 MB/s Jun 03 15:03:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:12 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf 1G Jun 03 15:03:12 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:12 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a Jun 03 15:03:12 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:13 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a" returned: 0 in 0.646s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.481s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:13 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1748316000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a80d34f-8c08-4c99-8100-1ad3479a54a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:05Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Creating volume 9a80d34f-8c08-4c99-8100-1ad3479a54a3 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:13 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf 1G" returned: 0 in 0.711s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:13 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3 1073741824 Jun 03 15:03:13 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db68dae1-678f-4a58-ba66-3a99cc830267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ce7935-b614-4d86-a344-5e848e31f84a', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16eccde7-284b-42d7-a29e-8233ce22d90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:13 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume volume-26ce7935-b614-4d86-a344-5e848e31f84a (26ce7935-b614-4d86-a344-5e848e31f84a): created successfully Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16eccde7-284b-42d7-a29e-8233ce22d90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (9bfd2ce9-ed61-4844-a602-7b71e324f883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae24de6-f638-435d-b8e0-0bc0daa3bd5c]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:13 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7bb13bed-489e-4e93-9eae-5f539be1e0d0 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created volume successfully. Jun 03 15:03:13 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf Jun 03 15:03:13 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:14 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf" returned: 0 in 0.768s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:14 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf Jun 03 15:03:14 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:14 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3 1073741824" returned: 0 in 1.007s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:14 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:14 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3 Jun 03 15:03:14 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:15 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf" returned: 1 in 0.809s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Downloaded image 0b9928f5-d4ec-45cc-8d04-0662ec6cce2c ((None, [{'url': 'file:///opt/stack/data/glance/images/0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'metadata': {}}])) to volume 8f36772e-55f1-4aba-a7c6-81d979ab78bf successfully. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Temporary image 0b9928f5-d4ec-45cc-8d04-0662ec6cce2c for user bea6caa6a27b49ebbc2eebf0a67f9f05 is deleted. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Marking volume 8f36772e-55f1-4aba-a7c6-81d979ab78bf as bootable. {{(pid=86614) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 03 15:03:15 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Copying metadata from image 0b9928f5-d4ec-45cc-8d04-0662ec6cce2c to 8f36772e-55f1-4aba-a7c6-81d979ab78bf. {{(pid=86614) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Creating volume glance metadata for volume 8f36772e-55f1-4aba-a7c6-81d979ab78bf backed by image 0b9928f5-d4ec-45cc-8d04-0662ec6cce2c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '12ea0d3bd969598a8c085c7a2c2210f3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86614) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3" returned: 0 in 0.658s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.823s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1483999868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2b52a5-cf7f-4d91-9355-69c3027199e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a305a9c624aec86fc4f4cea8edde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:05Z,use_quota=True,user_id='0ee13bb94eae4c89ad41826859a8688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Creating volume ef2b52a5-cf7f-4d91-9355-69c3027199e7 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:15 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:15 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7 1073741824 Jun 03 15:03:15 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9185d8-56e2-44d2-b4fd-145004b9ec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ff3cfd-a2e9-44e3-a1bd-75a5dd475f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:15 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3 (9a80d34f-8c08-4c99-8100-1ad3479a54a3): created successfully Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ff3cfd-a2e9-44e3-a1bd-75a5dd475f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (5ce222ad-cdbd-4675-9b75-4d5e9af774eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:15 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c8f18f27-e9f2-4ce2-819e-452918313482 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created volume successfully. Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6665285f-0930-4bcc-8f98-2e7f16f34c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf', 'volume_size': 1, 'image_id': '0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12ea0d3bd969598a8c085c7a2c2210f3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b06cda487b6444aaa1d25a35a4d09442', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c5968e62001dd607dc69d74ea225a949de00d23f0da129651b61e00319fd9f6678f7efb5a2072ca9eead9b0f17d6ab061f95bbc24436d3ea648df12553dee2b4', 'id': '0b9928f5-d4ec-45cc-8d04-0662ec6cce2c', 'created_at': datetime.datetime(2026, 6, 3, 13, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 2, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b9928f5-d4ec-45cc-8d04-0662ec6cce2c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce465fd-52df-4578-b600-680be5b2e504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:15 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Volume volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf (8f36772e-55f1-4aba-a7c6-81d979ab78bf): created successfully Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce465fd-52df-4578-b600-680be5b2e504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Flow 'volume_create_manager' (44afb6c2-0da6-4731-ab8c-cf7d80a49eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:15 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1ff6e75b-798e-4d66-ab46-006eace14923 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Created volume successfully. Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Acquiring lock "cinder-8f36772e-55f1-4aba-a7c6-81d979ab78bf-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Lock "cinder-8f36772e-55f1-4aba-a7c6-81d979ab78bf-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Acquiring lock "cinder-quobyte-8f36772e-55f1-4aba-a7c6-81d979ab78bf" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Lock "cinder-quobyte-8f36772e-55f1-4aba-a7c6-81d979ab78bf" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0aba9e-586b-40cd-8efb-e9c12de6cbf4]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:15 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:16 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf Jun 03 15:03:16 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:16 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7 1073741824" returned: 0 in 0.971s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:16 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7 Jun 03 15:03:16 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:16 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf" returned: 0 in 0.763s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:16 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf Jun 03 15:03:16 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:16 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7" returned: 0 in 0.662s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.773s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "cinder-quobyte-b25ba948-b962-43bd-b79a-b205fa17480e-22dc4045-5e94-46d6-a175-18a7d56d3a0c" by "_create_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e95e71-3590-4f3d-bc92-eae864c7cbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31499732-8d2d-437e-912b-4cc2b3e05bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-b25ba948-b962-43bd-b79a-b205fa17480e-22dc4045-5e94-46d6-a175-18a7d56d3a0c" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Creating volume 22dc4045-5e94-46d6-a175-18a7d56d3a0c from snapshot b25ba948-b962-43bd-b79a-b205fa17480e {{(pid=86614) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "cinder-quobyte-22dc4045-5e94-46d6-a175-18a7d56d3a0c" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:16 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Volume volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7 (ef2b52a5-cf7f-4d91-9355-69c3027199e7): created successfully Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31499732-8d2d-437e-912b-4cc2b3e05bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Flow 'volume_create_manager' (a6ff1f2b-2c0a-49c5-8c24-7b3d2f5e6c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-22dc4045-5e94-46d6-a175-18a7d56d3a0c" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] snapshot: b25ba948-b962-43bd-b79a-b205fa17480e, volume: 22dc4045-5e94-46d6-a175-18a7d56d3a0c, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:17 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-1a925dd9-a65b-4372-b18a-3b2c0a619722 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created volume successfully. Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Flow 'volume_create_manager' (fde9fc67-7194-4852-8b08-42365f917365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2001e371-600c-4717-a01d-755019a39b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6a1e58-19db-4fcd-b292-751be90306ea]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2001e371-600c-4717-a01d-755019a39b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1582976655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c21c12-a71a-472e-9372-e5b60a1e4598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb95cce58f64a23981a258960f54af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:17Z,use_quota=True,user_id='b27f6ae35e624f80abd26d0d18c43390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072ecef1-d929-469a-80e2-9ec7895c8743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072ecef1-d929-469a-80e2-9ec7895c8743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd139829-e0f2-4775-9fc5-1994b4814a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd139829-e0f2-4775-9fc5-1994b4814a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c21c12-a71a-472e-9372-e5b60a1e4598', 'volume_name': 'volume-a4c21c12-a71a-472e-9372-e5b60a1e4598', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52085723-d415-483e-af15-a29f613699d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52085723-d415-483e-af15-a29f613699d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd152733-5dcb-4393-8692-936018a78270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:17 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Volume a4c21c12-a71a-472e-9372-e5b60a1e4598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c21c12-a71a-472e-9372-e5b60a1e4598', 'volume_size': 1} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:17 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e Jun 03 15:03:17 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-ef2b52a5-cf7f-4d91-9355-69c3027199e7-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:17 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf" returned: 1 in 0.767s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-ef2b52a5-cf7f-4d91-9355-69c3027199e7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:17 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf Jun 03 15:03:17 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-quobyte-ef2b52a5-cf7f-4d91-9355-69c3027199e7" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-ef2b52a5-cf7f-4d91-9355-69c3027199e7" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff6367e-9dc6-4178-a1fe-497dbe721cc9]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:17 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7 Jun 03 15:03:17 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:17 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e" returned: 0 in 0.787s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5030c9d6-475f-4997-b469-c29e2d6f0b89]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:17 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 Jun 03 15:03:17 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:18 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8f36772e-55f1-4aba-a7c6-81d979ab78bf" returned: 0 in 0.637s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Lock "cinder-quobyte-8f36772e-55f1-4aba-a7c6-81d979ab78bf" released by "delete_volume" :: held 2.260s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Created reservations ['fa4c7c01-8eb2-4377-b89f-9e458d0c9de5', 'bcc505a7-8711-4d18-8536-0b3634f693a9', '500e9e82-5f7f-42ed-9397-8a9ebed20a2c', '4602a9dd-16e5-49e2-9cc3-d0fe1b3a993f'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:18 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:18 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:18 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7" returned: 0 in 0.782s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:18 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7 Jun 03 15:03:18 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:18 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72" returned: 0 in 0.730s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:18 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c Jun 03 15:03:18 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:18 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.601s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:18 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Deleted volume successfully. Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-feee5b35-2b87-45f1-97f0-a4491f287427 tempest-VolumeAndVolumeTypeFromImageTest-114220197 None] Lock "cinder-8f36772e-55f1-4aba-a7c6-81d979ab78bf-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:18 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-ef2b52a5-cf7f-4d91-9355-69c3027199e7" returned: 0 in 0.656s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:18 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-ef2b52a5-cf7f-4d91-9355-69c3027199e7" released by "delete_volume" :: held 1.479s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created reservations ['79075d96-7c38-4761-a861-bd4d75a81101', '453138cc-6f65-42db-bce9-7188eb7ac622', '8c17dbf9-2b33-4e08-8062-c71c64288862', 'ccbf8e87-6a61-454d-9e27-526d31219102'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:19 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:19 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-9a80d34f-8c08-4c99-8100-1ad3479a54a3-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-9a80d34f-8c08-4c99-8100-1ad3479a54a3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-quobyte-9a80d34f-8c08-4c99-8100-1ad3479a54a3" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:19 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-9a80d34f-8c08-4c99-8100-1ad3479a54a3" acquired by "delete_volume" :: waited 0.035s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:20 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd1fe6-f49c-403f-a92c-fcd6c62d6952]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:20 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3 Jun 03 15:03:20 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:20 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.245s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:20 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:20 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Deleted volume successfully. Jun 03 15:03:20 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9aed22e0-0caf-429e-a350-dc596598f7f4 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-ef2b52a5-cf7f-4d91-9355-69c3027199e7-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:21 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3" returned: 0 in 1.504s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:21 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3 Jun 03 15:03:21 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:23 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a80d34f-8c08-4c99-8100-1ad3479a54a3" returned: 0 in 1.693s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:23 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-9a80d34f-8c08-4c99-8100-1ad3479a54a3" released by "delete_volume" :: held 3.296s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:23 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created reservations ['a369a10f-02d3-4fa1-953c-7b59a3253a72', 'e5fc75aa-df14-4847-aa91-925880af3481', '598d269e-999e-489f-a7df-9c8cb71b66a0', '037e236c-3484-4e13-8dab-6ed47a604414'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:23 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:23 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:23 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-26ce7935-b614-4d86-a344-5e848e31f84a-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-26ce7935-b614-4d86-a344-5e848e31f84a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-quobyte-26ce7935-b614-4d86-a344-5e848e31f84a" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-26ce7935-b614-4d86-a344-5e848e31f84a" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:24 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee419b72-da78-41c6-895d-5ae4324cedb1]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c" returned: 0 in 6.218s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[952b304c-72b5-4691-9a8d-e914dde23f1b]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:24 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a Jun 03 15:03:24 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:24 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.426s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:24 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Deleted volume successfully. Jun 03 15:03:24 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 Jun 03 15:03:24 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:24 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b1530799-293c-4296-8764-87ba855cdca6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-9a80d34f-8c08-4c99-8100-1ad3479a54a3-delete_volume" released by "delete_volume" :: held 5.146s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:25 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a" returned: 0 in 0.750s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:25 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a Jun 03 15:03:25 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:25 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72" returned: 0 in 0.917s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:25 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 15:03:25 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Converted 1024.00 MB image at 164.63 MB/s Jun 03 15:03:25 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c is being set with open permissions: ugo+rw Jun 03 15:03:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:25 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c Jun 03 15:03:25 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:26 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-26ce7935-b614-4d86-a344-5e848e31f84a" returned: 0 in 0.633s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-26ce7935-b614-4d86-a344-5e848e31f84a" released by "delete_volume" :: held 1.449s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created reservations ['a4559ad3-a808-4ddf-8dbc-7ccc1554c41f', '1495bc91-ba61-4183-80a8-4ef06272f536', 'e6797e4a-1570-4b3f-b49c-a156be39af76', 'b71f6400-c3d8-40a7-81f0-33d84668267a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:26 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:26 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:26 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c" returned: 0 in 0.614s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-22dc4045-5e94-46d6-a175-18a7d56d3a0c" released by "_copy_volume_from_snapshot" :: held 9.408s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-b25ba948-b962-43bd-b79a-b205fa17480e-22dc4045-5e94-46d6-a175-18a7d56d3a0c" released by "_create_volume_from_snapshot" :: held 9.460s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.499s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.277s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1582976655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c21c12-a71a-472e-9372-e5b60a1e4598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb95cce58f64a23981a258960f54af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:17Z,use_quota=True,user_id='b27f6ae35e624f80abd26d0d18c43390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Creating volume a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:26 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:26 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 1073741824 Jun 03 15:03:26 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48b4a97-7573-477e-880c-89de3090d072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c', 'volume_size': 1, 'snapshot_id': 'b25ba948-b962-43bd-b79a-b205fa17480e'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbd065d-63fc-47ba-9d62-8e12010aa658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:26 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Volume volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c (22dc4045-5e94-46d6-a175-18a7d56d3a0c): created successfully Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbd065d-63fc-47ba-9d62-8e12010aa658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Flow 'volume_create_manager' (20a4e9fa-4ab6-4d34-98c2-21c721ec43a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:26 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e9768d4f-0679-4fef-a7b4-ee0bed5d219e tempest-VolumeDependencyTests-1322162741 None] Created volume successfully. Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Flow 'volume_create_manager' (d9f651cc-c824-4d1f-910a-4e575c204ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae7ba58-4ba0-43ee-9fc7-0527be969c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae7ba58-4ba0-43ee-9fc7-0527be969c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1167241911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e473bb9d-d47d-4183-92ca-8fcd15e42df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5512f7d574636ba5ee6afb01fc8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:27Z,use_quota=True,user_id='3562b622278d405bad0a020bb14a3d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394b876f-2607-4574-af83-52047339379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394b876f-2607-4574-af83-52047339379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27672f5-8cf9-404d-93af-034c38f8f4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27672f5-8cf9-404d-93af-034c38f8f4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e473bb9d-d47d-4183-92ca-8fcd15e42df6', 'volume_name': 'volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:26 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928c7477-ad3d-482f-bbdb-ca4e0a4895a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:26 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928c7477-ad3d-482f-bbdb-ca4e0a4895a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519589a4-b91e-450b-9527-9a069cd5f159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Volume e473bb9d-d47d-4183-92ca-8fcd15e42df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6', 'volume_size': 1} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.670s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:27 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Deleted volume successfully. Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b0786059-e4ac-4a19-84ac-1ea3b0c2f00f tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-26ce7935-b614-4d86-a344-5e848e31f84a-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-680666b3-2d9a-477f-8b7e-e6dad8abbc11-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-680666b3-2d9a-477f-8b7e-e6dad8abbc11-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-quobyte-680666b3-2d9a-477f-8b7e-e6dad8abbc11" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-680666b3-2d9a-477f-8b7e-e6dad8abbc11" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62540cb-3717-488a-9c1b-2b7638a67f2c]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:27 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11 Jun 03 15:03:27 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Flow 'volume_create_manager' (ec8e260c-1674-49e1-a350-5415c2f55660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f33b839-9df8-41b9-aa07-d0dd57e74e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f33b839-9df8-41b9-aa07-d0dd57e74e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989652026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d746aa6-0008-4bbe-98da-cccfe225f3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5512f7d574636ba5ee6afb01fc8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:27Z,use_quota=True,user_id='3562b622278d405bad0a020bb14a3d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc476dba-ea22-4f7d-be56-8e69f77a7e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc476dba-ea22-4f7d-be56-8e69f77a7e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb030f78-0661-4a00-bf30-5372f1fff42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb030f78-0661-4a00-bf30-5372f1fff42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d746aa6-0008-4bbe-98da-cccfe225f3c2', 'volume_name': 'volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b3bea8-6b1e-4d08-8b5e-da83f18ef322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b3bea8-6b1e-4d08-8b5e-da83f18ef322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1755d21-beeb-404e-9eac-d047ae70141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Volume 1d746aa6-0008-4bbe-98da-cccfe225f3c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2', 'volume_size': 1} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "cinder-b25ba948-b962-43bd-b79a-b205fa17480e-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-b25ba948-b962-43bd-b79a-b205fa17480e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "cinder-quobyte-b63d2666-e12a-4555-b70a-ab14f4ad0b72" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-b63d2666-e12a-4555-b70a-ab14f4ad0b72" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "cinder-quobyte-b25ba948-b962-43bd-b79a-b205fa17480e" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-b25ba948-b962-43bd-b79a-b205fa17480e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Deleting offline snapshot b25ba948-b962-43bd-b79a-b205fa17480e of volume b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 15:03:27 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] snapshot_file for this snap is: volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 1073741824" returned: 0 in 1.184s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd947a94-56a1-4f26-8949-8a9ed8ce5313]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Flow 'volume_create_manager' (8e5a9adb-1683-421a-a0c4-416471201641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e389508-4baa-4c36-899b-10447c65cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e389508-4baa-4c36-899b-10447c65cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136937123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb65d62-8d6b-4699-84eb-792e5fd6e5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5512f7d574636ba5ee6afb01fc8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:28Z,use_quota=True,user_id='3562b622278d405bad0a020bb14a3d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:27 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e Jun 03 15:03:27 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292497f3-febc-4a2a-8a9b-3d4a6936bb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292497f3-febc-4a2a-8a9b-3d4a6936bb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0071d3-9c6e-42e6-bf2c-40570b353766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0071d3-9c6e-42e6-bf2c-40570b353766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb65d62-8d6b-4699-84eb-792e5fd6e5da', 'volume_name': 'volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb0e63f-fc9f-46a8-a72c-6f8c5f713dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb0e63f-fc9f-46a8-a72c-6f8c5f713dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9a5ae4-e8de-448c-9440-a63084d2d023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:27 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Volume fdb65d62-8d6b-4699-84eb-792e5fd6e5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da', 'volume_size': 1} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:27 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 Jun 03 15:03:27 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Flow 'volume_create_manager' (266b80a3-51bb-4fd4-aec4-8ff9e5939beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67d3f0b-3d44-4f14-8b63-d622da252bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67d3f0b-3d44-4f14-8b63-d622da252bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-96574268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6d094b-7845-40ec-b2c4-e674792bbe5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5512f7d574636ba5ee6afb01fc8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:28Z,use_quota=True,user_id='3562b622278d405bad0a020bb14a3d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e3e6cf-9ad2-4fe1-83d9-c4b6e6e74c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e3e6cf-9ad2-4fe1-83d9-c4b6e6e74c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f0194b-e3f4-4a3f-be61-6e1692b5a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f0194b-e3f4-4a3f-be61-6e1692b5a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a6d094b-7845-40ec-b2c4-e674792bbe5b', 'volume_name': 'volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49901346-2df9-49b0-902a-a04acd3e058d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49901346-2df9-49b0-902a-a04acd3e058d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:28 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0cfdc5-e5cb-401e-96cf-d9b9d18639dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Volume 9a6d094b-7845-40ec-b2c4-e674792bbe5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b', 'volume_size': 1} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11" returned: 0 in 1.019s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:28 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11 Jun 03 15:03:28 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:28 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e" returned: 0 in 0.845s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f94937-76f6-4f77-af85-33be9ee13bb2]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Flow 'volume_create_manager' (6925ecca-9490-40fd-a08d-8f5df823989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d75f6d0-5592-4675-8f3d-924c3ca3e5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d75f6d0-5592-4675-8f3d-924c3ca3e5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023247556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6cb934b-5834-4e1d-ab39-523696978328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5512f7d574636ba5ee6afb01fc8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:28Z,use_quota=True,user_id='3562b622278d405bad0a020bb14a3d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8aca55-7a3c-452c-98ae-6723337f390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8aca55-7a3c-452c-98ae-6723337f390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affffc0d-827b-491f-ab40-66ed646ce12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affffc0d-827b-491f-ab40-66ed646ce12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6cb934b-5834-4e1d-ab39-523696978328', 'volume_name': 'volume-d6cb934b-5834-4e1d-ab39-523696978328', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25027973-d0da-48af-ba1d-f27820238ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25027973-d0da-48af-ba1d-f27820238ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96aef0c1-e9ab-4c4d-be0a-a2e3f12eb6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Volume d6cb934b-5834-4e1d-ab39-523696978328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6cb934b-5834-4e1d-ab39-523696978328', 'volume_size': 1} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:28 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 Jun 03 15:03:28 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:28 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598" returned: 0 in 0.896s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.687s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1167241911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e473bb9d-d47d-4183-92ca-8fcd15e42df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5512f7d574636ba5ee6afb01fc8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:27Z,use_quota=True,user_id='3562b622278d405bad0a020bb14a3d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Creating volume e473bb9d-d47d-4183-92ca-8fcd15e42df6 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:28 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:28 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6 1073741824 Jun 03 15:03:28 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd152733-5dcb-4393-8692-936018a78270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c21c12-a71a-472e-9372-e5b60a1e4598', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7580540-8f5e-4467-954a-a272d282a95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:28 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Volume volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 (a4c21c12-a71a-472e-9372-e5b60a1e4598): created successfully Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7580540-8f5e-4467-954a-a272d282a95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Flow 'volume_create_manager' (fde9fc67-7194-4852-8b08-42365f917365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:28 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-ab654a63-4384-46aa-a986-b995790fd6c5 tempest-SnapshotDependencyTests-452008653 None] Created volume successfully. Jun 03 15:03:28 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-680666b3-2d9a-477f-8b7e-e6dad8abbc11" returned: 0 in 0.724s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-680666b3-2d9a-477f-8b7e-e6dad8abbc11" released by "delete_volume" :: held 1.792s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:28 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created reservations ['b41328cd-2adc-4c3b-8bab-d885d106f5d3', '27d70689-d974-4586-a3e9-5273c2daaec7', '59818454-edeb-422a-b5b7-51e0a8cc3b6a', '262b3c79-444b-42ce-ab28-192f2f016f38'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:29 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:29 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:29 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72" returned: 0 in 0.817s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:29 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e Jun 03 15:03:29 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-fcd3c8e1-4e23-4890-9d66-b9dbb182c176-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-fcd3c8e1-4e23-4890-9d66-b9dbb182c176-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-quobyte-fcd3c8e1-4e23-4890-9d66-b9dbb182c176" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-fcd3c8e1-4e23-4890-9d66-b9dbb182c176" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5660e65-d990-4dd7-b1cb-5de5350363cc]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:29 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176 Jun 03 15:03:29 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:29 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6 1073741824" returned: 0 in 0.996s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:29 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6 Jun 03 15:03:29 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:29 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.788s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:29 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Deleted volume successfully. Jun 03 15:03:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d0b53f77-2c4e-495e-a267-c9cf1fcb6bf6 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-680666b3-2d9a-477f-8b7e-e6dad8abbc11-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:30 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e" returned: 0 in 0.848s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:30 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e Jun 03 15:03:30 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:30 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176" returned: 0 in 0.727s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:30 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176 Jun 03 15:03:30 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:30 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6" returned: 0 in 0.628s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.898s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989652026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d746aa6-0008-4bbe-98da-cccfe225f3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5512f7d574636ba5ee6afb01fc8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:27Z,use_quota=True,user_id='3562b622278d405bad0a020bb14a3d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Creating volume 1d746aa6-0008-4bbe-98da-cccfe225f3c2 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:30 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519589a4-b91e-450b-9527-9a069cd5f159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:30 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2 1073741824 Jun 03 15:03:30 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6b075c-99a9-4465-82d4-3a34082e8638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:30 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Volume volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6 (e473bb9d-d47d-4183-92ca-8fcd15e42df6): created successfully Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6b075c-99a9-4465-82d4-3a34082e8638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Flow 'volume_create_manager' (d9f651cc-c824-4d1f-910a-4e575c204ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:30 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-27286c56-a533-493c-9c70-41f5b75f9dee tempest-CreateVolumesFromImageTest-111628593 None] Created volume successfully. Jun 03 15:03:30 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72.b25ba948-b962-43bd-b79a-b205fa17480e" returned: 0 in 0.670s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-b25ba948-b962-43bd-b79a-b205fa17480e" released by "_delete_snapshot" :: held 3.319s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-b63d2666-e12a-4555-b70a-ab14f4ad0b72" released by "delete_snapshot" :: held 3.354s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Created reservations ['ff0ff85d-33af-465d-a471-7e822e7f77e1', '8487336a-3c5e-4852-a3bd-cfb683d95902', '1c6a2392-1e96-4b5d-ac63-712c35b0d042', '61985758-74b7-4656-a606-aa324aa3e3fd'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:30 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fcd3c8e1-4e23-4890-9d66-b9dbb182c176" returned: 0 in 0.652s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-fcd3c8e1-4e23-4890-9d66-b9dbb182c176" released by "delete_volume" :: held 1.440s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Delete snapshot completed successfully. Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c8e4d362-2923-46e7-ae63-c20391799464 tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-b25ba948-b962-43bd-b79a-b205fa17480e-delete_snapshot" released by "delete_snapshot" :: held 3.523s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created reservations ['1237de0f-adbe-4c96-a5cf-87e17fca748d', 'eb878a4f-ff14-407e-92d3-a49758ba108a', 'cd5fdab0-2c66-44d8-8b92-f5a69675b628', '6420eb80-ae85-44a7-89a5-4ad521b7357e'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:31 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:31 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:31 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2 1073741824" returned: 0 in 0.847s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:31 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2 Jun 03 15:03:31 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-e4afaa24-c35d-41b6-852b-6fe557cadabe-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-e4afaa24-c35d-41b6-852b-6fe557cadabe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-quobyte-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:31 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.584s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-quobyte-e4afaa24-c35d-41b6-852b-6fe557cadabe" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:31 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Deleted volume successfully. Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-e4afaa24-c35d-41b6-852b-6fe557cadabe" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Deleting offline snapshot e4afaa24-c35d-41b6-852b-6fe557cadabe of volume 2ef56aa0-0141-41a0-84ca-d238cfccd1ea {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] snapshot_file for this snap is: volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c0ca690f-c246-4d87-b25b-3a6a6b110af9 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-fcd3c8e1-4e23-4890-9d66-b9dbb182c176-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[28294dad-81a2-44fd-9551-a9c22fb65cf3]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:31 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe Jun 03 15:03:31 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:31 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2" returned: 0 in 0.656s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.138s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136937123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb65d62-8d6b-4699-84eb-792e5fd6e5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5512f7d574636ba5ee6afb01fc8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:28Z,use_quota=True,user_id='3562b622278d405bad0a020bb14a3d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Creating volume fdb65d62-8d6b-4699-84eb-792e5fd6e5da {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:31 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "cinder-b63d2666-e12a-4555-b70a-ab14f4ad0b72-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1755d21-beeb-404e-9eac-d047ae70141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:31 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9875e82-6771-417f-b66f-57d78ba06928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:31 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da 1073741824 Jun 03 15:03:31 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:32 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Volume volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2 (1d746aa6-0008-4bbe-98da-cccfe225f3c2): created successfully Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9875e82-6771-417f-b66f-57d78ba06928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Flow 'volume_create_manager' (ec8e260c-1674-49e1-a350-5415c2f55660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-b63d2666-e12a-4555-b70a-ab14f4ad0b72-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:32 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8a5069a9-d0e6-49b1-86c8-056245415df1 tempest-CreateVolumesFromImageTest-111628593 None] Created volume successfully. Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "cinder-quobyte-b63d2666-e12a-4555-b70a-ab14f4ad0b72" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-b63d2666-e12a-4555-b70a-ab14f4ad0b72" acquired by "delete_volume" :: waited 0.013s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fa06cc-0882-4331-8b32-60deddfbd6f1]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:32 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 Jun 03 15:03:32 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:32 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe" returned: 0 in 0.747s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff23ba09-8898-4080-9656-8c03acd3cf14]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:32 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea Jun 03 15:03:32 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:32 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da 1073741824" returned: 0 in 0.891s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:32 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72" returned: 0 in 0.769s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:32 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da Jun 03 15:03:32 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:32 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72 Jun 03 15:03:32 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:33 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" returned: 0 in 0.713s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:33 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe Jun 03 15:03:33 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:33 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da" returned: 0 in 0.601s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.287s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-96574268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6d094b-7845-40ec-b2c4-e674792bbe5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5512f7d574636ba5ee6afb01fc8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:28Z,use_quota=True,user_id='3562b622278d405bad0a020bb14a3d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Creating volume 9a6d094b-7845-40ec-b2c4-e674792bbe5b {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:33 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:33 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b63d2666-e12a-4555-b70a-ab14f4ad0b72" returned: 0 in 0.620s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:33 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b 1073741824 Jun 03 15:03:33 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9a5ae4-e8de-448c-9440-a63084d2d023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b2d0e3-2d6e-46e9-89de-06d4f19499e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-b63d2666-e12a-4555-b70a-ab14f4ad0b72" released by "delete_volume" :: held 1.488s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:33 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Volume volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da (fdb65d62-8d6b-4699-84eb-792e5fd6e5da): created successfully Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b2d0e3-2d6e-46e9-89de-06d4f19499e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Flow 'volume_create_manager' (8e5a9adb-1683-421a-a0c4-416471201641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:33 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f8b1500b-9774-41ba-89e0-08ac0d013ead tempest-CreateVolumesFromImageTest-111628593 None] Created volume successfully. Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Created reservations ['bc6fe819-1a24-4f43-a5b2-4648bf14505d', 'a863b735-bca8-4b91-a99b-1ea3372f805e', 'edbaa14f-c33c-493d-bd98-f7512522d6a1', '47b84488-f1b5-4e64-8e2d-4e22f43c7c1c'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:33 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:33 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:33 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe" returned: 0 in 0.686s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:33 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:33 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe Jun 03 15:03:33 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "cinder-22dc4045-5e94-46d6-a175-18a7d56d3a0c-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-22dc4045-5e94-46d6-a175-18a7d56d3a0c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "cinder-quobyte-22dc4045-5e94-46d6-a175-18a7d56d3a0c" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-22dc4045-5e94-46d6-a175-18a7d56d3a0c" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee074a56-3f5b-4c53-9860-d94f81dd67ae]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:34 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b 1073741824" returned: 0 in 0.889s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:34 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.680s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:34 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Deleted volume successfully. Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:34 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c Jun 03 15:03:34 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-3956c0b7-92d6-4ccc-b6ac-e83bc2e80b1d tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-b63d2666-e12a-4555-b70a-ab14f4ad0b72-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:34 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b Jun 03 15:03:34 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:34 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea.e4afaa24-c35d-41b6-852b-6fe557cadabe" returned: 0 in 0.651s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-e4afaa24-c35d-41b6-852b-6fe557cadabe" released by "_delete_snapshot" :: held 2.927s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" released by "delete_snapshot" :: held 2.974s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created reservations ['fd7a375e-a22e-4d06-983f-abda3e038350', '8860c376-2df2-4286-ac16-da558e5a9959', '2412c4bb-03b6-48b9-9aa8-c8fc49e5cf0b', '0b915620-8683-459d-9a56-bd8445721c74'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:34 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Delete snapshot completed successfully. Jun 03 15:03:34 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-532705b9-e110-438c-af16-93c569e2cc95 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-e4afaa24-c35d-41b6-852b-6fe557cadabe-delete_snapshot" released by "delete_snapshot" :: held 3.192s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:35 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b" returned: 0 in 0.620s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.437s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023247556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6cb934b-5834-4e1d-ab39-523696978328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5512f7d574636ba5ee6afb01fc8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:28Z,use_quota=True,user_id='3562b622278d405bad0a020bb14a3d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Creating volume d6cb934b-5834-4e1d-ab39-523696978328 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:35 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:35 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c" returned: 0 in 0.757s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:35 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328 1073741824 Jun 03 15:03:35 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0cfdc5-e5cb-401e-96cf-d9b9d18639dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:35 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c Jun 03 15:03:35 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1139f7ed-4267-4b5b-b585-3bfd37ce161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:35 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Volume volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b (9a6d094b-7845-40ec-b2c4-e674792bbe5b): created successfully Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1139f7ed-4267-4b5b-b585-3bfd37ce161d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Flow 'volume_create_manager' (266b80a3-51bb-4fd4-aec4-8ff9e5939beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:35 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-15141e30-ef94-43a1-9b26-dcbe159a6655 tempest-CreateVolumesFromImageTest-111628593 None] Created volume successfully. Jun 03 15:03:35 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-22dc4045-5e94-46d6-a175-18a7d56d3a0c" returned: 0 in 0.623s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-quobyte-22dc4045-5e94-46d6-a175-18a7d56d3a0c" released by "delete_volume" :: held 1.425s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Created reservations ['68ada2f5-e185-4fa8-89a5-562d4ae07996', '54132012-437d-41aa-a36c-42e411e58c65', '9ee2af86-787b-4169-9968-faf2c03896ee', 'e7c0a85c-f980-417b-86b4-2007151801a6'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:35 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:35 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:35 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328 1073741824" returned: 0 in 0.800s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-2ef56aa0-0141-41a0-84ca-d238cfccd1ea-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-2ef56aa0-0141-41a0-84ca-d238cfccd1ea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:35 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328 Jun 03 15:03:35 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "cinder-quobyte-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:35 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[af892712-8614-49fd-a06f-62693787f3dc]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:36 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea Jun 03 15:03:36 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:36 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.608s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:36 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Deleted volume successfully. Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-24207fdd-91e4-471f-8f32-d7b4ec79433c tempest-VolumeDependencyTests-1322162741 None] Lock "cinder-22dc4045-5e94-46d6-a175-18a7d56d3a0c-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:36 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328" returned: 0 in 0.670s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.073s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96aef0c1-e9ab-4c4d-be0a-a2e3f12eb6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6cb934b-5834-4e1d-ab39-523696978328', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d2dd19-354a-4083-ba39-56c292c0dba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Creating offline snapshot 318f21a7-caf0-4f83-b41c-04651373df63 of volume a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 15:03:36 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Volume volume-d6cb934b-5834-4e1d-ab39-523696978328 (d6cb934b-5834-4e1d-ab39-523696978328): created successfully Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d2dd19-354a-4083-ba39-56c292c0dba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Flow 'volume_create_manager' (6925ecca-9490-40fd-a08d-8f5df823989a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f78c7a7-1f7b-4120-9ffd-7f40a3154557]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:36 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-006a8fed-73c2-4245-8767-f3d45c0c010c tempest-CreateVolumesFromImageTest-111628593 None] Created volume successfully. Jun 03 15:03:36 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" returned: 0 in 0.775s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:36 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:36 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 Jun 03 15:03:36 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:36 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea Jun 03 15:03:36 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "cinder-d6cb934b-5834-4e1d-ab39-523696978328-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-d6cb934b-5834-4e1d-ab39-523696978328-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:37 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" returned: 0 in 0.662s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "cinder-quobyte-d6cb934b-5834-4e1d-ab39-523696978328" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:37 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-quobyte-2ef56aa0-0141-41a0-84ca-d238cfccd1ea" released by "delete_volume" :: held 1.509s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598" returned: 0 in 0.830s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-quobyte-d6cb934b-5834-4e1d-ab39-523696978328" acquired by "delete_volume" :: waited 0.038s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9f2087-f026-4a8a-9c6e-df88a3f2e402]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:37 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 1G Jun 03 15:03:37 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Created reservations ['352ef193-71ae-4f36-8b8c-010b33ee3c66', '36d7bf8b-20f8-4d29-aaff-149c0f0c0880', '41152226-42ef-4e36-aae1-d9d3e3783d4c', '7fb4405a-afe7-41db-abbd-a8e0dfd78246'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:37 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328 Jun 03 15:03:37 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:37 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:37 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:37 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:38 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328" returned: 0 in 0.900s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:38 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328 Jun 03 15:03:38 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:38 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.857s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:38 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:38 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Deleted volume successfully. Jun 03 15:03:38 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 1G" returned: 0 in 1.047s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:38 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:38 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-fa6e66e0-a041-4d0a-9115-7b9739885319 tempest-CreateVolumesFromSnapshotTest-1365353209 None] Lock "cinder-2ef56aa0-0141-41a0-84ca-d238cfccd1ea-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:38 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 Jun 03 15:03:38 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:39 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-d6cb934b-5834-4e1d-ab39-523696978328" returned: 0 in 0.670s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-quobyte-d6cb934b-5834-4e1d-ab39-523696978328" released by "delete_volume" :: held 1.619s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Created reservations ['c460c2ce-aada-49c2-9831-771bb99ec5ba', '4486da77-dc9f-4cac-9c10-96700332b63c', '67de6ce9-5b50-475c-9004-5afde33e612f', '33904524-61a7-48b5-bf39-9df3c171bede'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:39 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63" returned: 0 in 0.704s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:39 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 is being set with open permissions: ugo+rw Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:39 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:39 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:39 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 Jun 03 15:03:39 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "cinder-9a6d094b-7845-40ec-b2c4-e674792bbe5b-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-9a6d094b-7845-40ec-b2c4-e674792bbe5b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "cinder-quobyte-9a6d094b-7845-40ec-b2c4-e674792bbe5b" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-quobyte-9a6d094b-7845-40ec-b2c4-e674792bbe5b" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7026e135-3d7f-47c1-8379-3f86db7e2793]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:39 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b Jun 03 15:03:39 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:39 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63" returned: 0 in 0.689s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:39 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:39 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.750s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:40 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:40 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Deleted volume successfully. Jun 03 15:03:40 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.info Jun 03 15:03:40 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:40 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-d45bddcf-8f21-4966-b099-1d64d1713f02 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-d6cb934b-5834-4e1d-ab39-523696978328-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:40 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b" returned: 0 in 0.795s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:40 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.info" returned: 0 in 0.630s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:40 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.info is being set with open permissions: ugo+rw Jun 03 15:03:40 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:40 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b Jun 03 15:03:40 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:40 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.info Jun 03 15:03:40 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (eb00f9c1-9455-47ec-a1d3-81403aa4f037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad29928f-615f-4cce-8eed-019f67a202ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad29928f-615f-4cce-8eed-019f67a202ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1154935345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd0f096-fc5b-4a38-a788-cc8d33c38e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:41Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:41 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb57c84-7da1-4e30-99b5-a712cf01b8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb57c84-7da1-4e30-99b5-a712cf01b8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92280f3c-f544-4bb8-8680-69d467582968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92280f3c-f544-4bb8-8680-69d467582968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd0f096-fc5b-4a38-a788-cc8d33c38e28', 'volume_name': 'volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f15881-b809-4575-ad52-1bc6687fcc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f15881-b809-4575-ad52-1bc6687fcc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67456337-0226-40b4-b71b-94b3184352f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:41 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume 4fd0f096-fc5b-4a38-a788-cc8d33c38e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28', 'volume_size': 1} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.info" returned: 0 in 0.649s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.693s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1154935345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd0f096-fc5b-4a38-a788-cc8d33c38e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:41Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Creating volume 4fd0f096-fc5b-4a38-a788-cc8d33c38e28 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:41 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:41 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9a6d094b-7845-40ec-b2c4-e674792bbe5b" returned: 0 in 0.712s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:41 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28 1073741824 Jun 03 15:03:41 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-quobyte-9a6d094b-7845-40ec-b2c4-e674792bbe5b" released by "delete_volume" :: held 1.568s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:41 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4e00ec58-89dd-43e6-acaa-31495a85f68b tempest-SnapshotDependencyTests-452008653 None] Create snapshot completed successfully Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Created reservations ['4b1064a8-7ac7-4fc4-a53a-3890fcf66203', '15e88c26-99ac-41fc-b720-6ce8cfacc933', 'c222b70f-6672-4050-9800-2fdc2d22c451', 'f172efc4-126a-4a04-8f77-eaefa50d24e4'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:41 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:41 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "cinder-fdb65d62-8d6b-4699-84eb-792e5fd6e5da-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:41 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-fdb65d62-8d6b-4699-84eb-792e5fd6e5da-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "cinder-quobyte-fdb65d62-8d6b-4699-84eb-792e5fd6e5da" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-quobyte-fdb65d62-8d6b-4699-84eb-792e5fd6e5da" acquired by "delete_volume" :: waited 0.016s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc65522-f6b6-4f39-9176-7869f638aa45]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:42 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.687s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:42 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Deleted volume successfully. Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-a021ddad-1fee-48f1-b08d-69994697b921 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-9a6d094b-7845-40ec-b2c4-e674792bbe5b-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:42 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da Jun 03 15:03:42 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:42 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28 1073741824" returned: 0 in 0.926s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:42 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28 Jun 03 15:03:42 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Flow 'volume_create_manager' (2286267c-64bb-428c-8c05-660a0aa6a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6571ace-fa7b-48e0-b753-df2b9b20a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6571ace-fa7b-48e0-b753-df2b9b20a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99c5aee-a247-42ae-a1ca-d8528570ee07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb95cce58f64a23981a258960f54af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=318f21a7-caf0-4f83-b41c-04651373df63,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:42Z,use_quota=True,user_id='b27f6ae35e624f80abd26d0d18c43390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690390d0-91a3-4cfb-b3cb-356dd04f22b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690390d0-91a3-4cfb-b3cb-356dd04f22b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757fb66d-c49a-4fec-8e28-1a627b7cfa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757fb66d-c49a-4fec-8e28-1a627b7cfa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b99c5aee-a247-42ae-a1ca-d8528570ee07', 'volume_name': 'volume-b99c5aee-a247-42ae-a1ca-d8528570ee07', 'volume_size': 1, 'snapshot_id': '318f21a7-caf0-4f83-b41c-04651373df63'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c27a502-e271-4058-840d-df824ef6fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c27a502-e271-4058-840d-df824ef6fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb391d0b-1dbb-497b-b67a-800eb1568347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:42 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Volume b99c5aee-a247-42ae-a1ca-d8528570ee07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b99c5aee-a247-42ae-a1ca-d8528570ee07', 'volume_size': 1, 'snapshot_id': '318f21a7-caf0-4f83-b41c-04651373df63'} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:42 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da" returned: 0 in 0.784s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:42 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28" returned: 0 in 0.625s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:42 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da Jun 03 15:03:42 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.254s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "cinder-quobyte-318f21a7-caf0-4f83-b41c-04651373df63-b99c5aee-a247-42ae-a1ca-d8528570ee07" by "_create_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67456337-0226-40b4-b71b-94b3184352f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2aecb9c-baf3-4ef4-b82a-1e3c4dfb87df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-318f21a7-caf0-4f83-b41c-04651373df63-b99c5aee-a247-42ae-a1ca-d8528570ee07" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Creating volume b99c5aee-a247-42ae-a1ca-d8528570ee07 from snapshot 318f21a7-caf0-4f83-b41c-04651373df63 {{(pid=86614) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "cinder-quobyte-b99c5aee-a247-42ae-a1ca-d8528570ee07" by "_copy_volume_from_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:42 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28 (4fd0f096-fc5b-4a38-a788-cc8d33c38e28): created successfully Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2aecb9c-baf3-4ef4-b82a-1e3c4dfb87df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (eb00f9c1-9455-47ec-a1d3-81403aa4f037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-b99c5aee-a247-42ae-a1ca-d8528570ee07" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] snapshot: 318f21a7-caf0-4f83-b41c-04651373df63, volume: b99c5aee-a247-42ae-a1ca-d8528570ee07, {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:42 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:43 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-2dec779e-5235-427a-b99e-c23c10195985 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created volume successfully. Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed623f3-c2fa-427d-b138-98ee52568266]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:43 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 Jun 03 15:03:43 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:43 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-fdb65d62-8d6b-4699-84eb-792e5fd6e5da" returned: 0 in 0.609s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-quobyte-fdb65d62-8d6b-4699-84eb-792e5fd6e5da" released by "delete_volume" :: held 1.442s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Created reservations ['8f73e4e7-4595-4195-84ea-b48d195a63c5', 'a684cec2-c5b5-4749-8d69-83af4994311c', '3ce1000e-a159-4f81-b8b5-0eda669faa6e', 'f6f9583c-09c5-470c-a1d6-61c933ecb614'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:43 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:43 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:43 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63" returned: 0 in 0.755s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4c21c12-a71a-472e-9372-e5b60a1e4598(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Creating direct copy from snapshot {{(pid=86614) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (cc585a7e-f653-42cf-9c06-b5dd574692e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee72963-3b66-4ecf-b6ac-7880bf86163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0623f5-0ad4-4ff6-a77c-819b6d7c9171]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee72963-3b66-4ecf-b6ac-7880bf86163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1740738114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a04e62-49e1-42ce-b595-97d9e38b0d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:44Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53e6ada-edc3-49ad-a403-6e2d532692b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53e6ada-edc3-49ad-a403-6e2d532692b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51154715-939c-405d-856b-995c7860c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51154715-939c-405d-856b-995c7860c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a04e62-49e1-42ce-b595-97d9e38b0d39', 'volume_name': 'volume-52a04e62-49e1-42ce-b595-97d9e38b0d39', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958acac1-4ff2-4b10-843e-929cfe34e12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958acac1-4ff2-4b10-843e-929cfe34e12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf6d100-4185-4546-ab31-146d85e61f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:43 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume 52a04e62-49e1-42ce-b595-97d9e38b0d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a04e62-49e1-42ce-b595-97d9e38b0d39', 'volume_size': 1} Jun 03 15:03:43 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:43 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 Jun 03 15:03:43 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (e959d722-8012-43ad-8bdf-3828d951b570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c05249-7d10-4773-a525-7479b40abf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c05249-7d10-4773-a525-7479b40abf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1755764573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5760c4e1-46d2-4ac9-950f-67898d2fd4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:44Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb47f37-6800-40cb-b755-04183f871da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb47f37-6800-40cb-b755-04183f871da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e21cf8d-785d-4236-b57b-e7155babbf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e21cf8d-785d-4236-b57b-e7155babbf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5760c4e1-46d2-4ac9-950f-67898d2fd4f5', 'volume_name': 'volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a268e155-5ba0-4706-a3e3-53361eb442ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a268e155-5ba0-4706-a3e3-53361eb442ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71ce9e7-0f73-487c-ba1c-553df266289d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:44 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume 5760c4e1-46d2-4ac9-950f-67898d2fd4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5', 'volume_size': 1} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "cinder-1d746aa6-0008-4bbe-98da-cccfe225f3c2-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-1d746aa6-0008-4bbe-98da-cccfe225f3c2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "cinder-quobyte-1d746aa6-0008-4bbe-98da-cccfe225f3c2" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-quobyte-1d746aa6-0008-4bbe-98da-cccfe225f3c2" acquired by "delete_volume" :: waited 0.021s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8d606a-aabb-4d18-9504-2886710eb1e5]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:44 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.784s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:44 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Deleted volume successfully. Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-9ad40e66-d30a-4aa4-b34d-d2dbee50f678 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-fdb65d62-8d6b-4699-84eb-792e5fd6e5da-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:44 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2 Jun 03 15:03:44 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (b9aea2f6-b9d5-4635-8f71-fbe6acba9e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7287ad52-ca0d-4a5b-b1ce-4ecff0df2d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7287ad52-ca0d-4a5b-b1ce-4ecff0df2d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1283638563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40edcc3-e32b-4961-946a-b3970041fcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:45Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3509ad7-2372-4acb-a684-56e1c5a60007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:44 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3509ad7-2372-4acb-a684-56e1c5a60007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b8c51f-4005-454d-8e1a-bea600e68fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b8c51f-4005-454d-8e1a-bea600e68fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e40edcc3-e32b-4961-946a-b3970041fcb2', 'volume_name': 'volume-e40edcc3-e32b-4961-946a-b3970041fcb2', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4035778-55a3-47a8-9a5e-6f93f34f7e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4035778-55a3-47a8-9a5e-6f93f34f7e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76305238-4e3c-4963-894a-a739bb159068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:44 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume e40edcc3-e32b-4961-946a-b3970041fcb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e40edcc3-e32b-4961-946a-b3970041fcb2', 'volume_size': 1} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598" returned: 0 in 0.907s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.utils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Path /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 not found in is_blk_device check {{(pid=86614) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:44 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 Jun 03 15:03:44 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:44 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (4164049b-442d-4292-ad2a-3e17e4331b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e4ec64-8e34-4bbf-a025-7c01cf0e9b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e4ec64-8e34-4bbf-a025-7c01cf0e9b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1610132214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020cbea0-2907-42cc-8577-d432bc11a9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:45Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa85d86-b46c-4dd2-8ee5-d24bb7593142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa85d86-b46c-4dd2-8ee5-d24bb7593142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852ad697-1b03-4f28-931d-be9d8be8a4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852ad697-1b03-4f28-931d-be9d8be8a4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020cbea0-2907-42cc-8577-d432bc11a9ae', 'volume_name': 'volume-020cbea0-2907-42cc-8577-d432bc11a9ae', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afdf190-2314-4f62-a595-2e43c297eb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afdf190-2314-4f62-a595-2e43c297eb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4845966b-f489-4904-a865-30162cfad7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:45 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume 020cbea0-2907-42cc-8577-d432bc11a9ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020cbea0-2907-42cc-8577-d432bc11a9ae', 'volume_size': 1} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:45 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2" returned: 0 in 0.836s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:45 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2 Jun 03 15:03:45 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (cb6ef377-e8ce-47b8-bda6-b4dfb72b6444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6777e33-d42e-4411-9550-62d58e3e9fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6777e33-d42e-4411-9550-62d58e3e9fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1641457092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9408f3-84e3-4ab8-91ad-45e3bc323cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:45Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beee17f2-d37d-44a8-a1e5-c7ae78190dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beee17f2-d37d-44a8-a1e5-c7ae78190dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a556430-3e51-4933-9282-7b1698727962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a556430-3e51-4933-9282-7b1698727962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c9408f3-84e3-4ab8-91ad-45e3bc323cff', 'volume_name': 'volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b3c5f0-af0f-4f1d-9a46-6758b4526b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b3c5f0-af0f-4f1d-9a46-6758b4526b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e5c1cf-2beb-4186-bbc0-3b33beb81914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:45 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume 8c9408f3-84e3-4ab8-91ad-45e3bc323cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff', 'volume_size': 1} Jun 03 15:03:45 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:46 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-1d746aa6-0008-4bbe-98da-cccfe225f3c2" returned: 0 in 1.321s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:46 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-quobyte-1d746aa6-0008-4bbe-98da-cccfe225f3c2" released by "delete_volume" :: held 2.234s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:46 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Created reservations ['26464bd5-a6cf-4aad-a62a-9a8f29d7670b', '5b92062b-bf1b-4e2b-9788-cd3b5350816c', '893dfb5d-2918-456f-976c-04ccba3515e8', '7b0d99cb-4d0e-4945-bd25-8b45d7de7aeb'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:46 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:46 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:46 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:46 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:47 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "cinder-e473bb9d-d47d-4183-92ca-8fcd15e42df6-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:48 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 1.215s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:48 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:48 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-e473bb9d-d47d-4183-92ca-8fcd15e42df6-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:48 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Deleted volume successfully. Jun 03 15:03:48 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f45c7cb5-0137-4443-8f21-703c53df8942 tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-1d746aa6-0008-4bbe-98da-cccfe225f3c2-delete_volume" released by "delete_volume" :: held 3.862s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:48 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "cinder-quobyte-e473bb9d-d47d-4183-92ca-8fcd15e42df6" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:48 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-quobyte-e473bb9d-d47d-4183-92ca-8fcd15e42df6" acquired by "delete_volume" :: waited 0.040s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:48 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5e8176-3b46-487e-b853-dea1878b7efe]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:48 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:48 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6 Jun 03 15:03:48 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:49 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6" returned: 0 in 1.346s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:49 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:49 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6 Jun 03 15:03:49 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:50 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07" returned: 0 in 5.459s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ce6164-fada-4ff7-879f-0eeb195638cd]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:50 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 Jun 03 15:03:50 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:50 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e473bb9d-d47d-4183-92ca-8fcd15e42df6" returned: 0 in 0.751s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-quobyte-e473bb9d-d47d-4183-92ca-8fcd15e42df6" released by "delete_volume" :: held 2.182s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Created reservations ['c679255f-3e26-4275-8663-ee990b38dda4', '591ebcb0-1667-4fc1-a63c-8228024e3c92', '0328e987-c65f-4047-9486-7869a0f51634', '4addaac5-e330-4739-a445-4c8b0ea921ca'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:50 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:50 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:50 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:51 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.578s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:51 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Deleted volume successfully. Jun 03 15:03:51 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598" returned: 0 in 0.886s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 15:03:51 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Converted 1024.00 MB image at 187.52 MB/s Jun 03 15:03:51 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 is being set with open permissions: ugo+rw Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-4a8f9230-8bc2-406e-a61b-e14a54b016ce tempest-CreateVolumesFromImageTest-111628593 None] Lock "cinder-e473bb9d-d47d-4183-92ca-8fcd15e42df6-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:51 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 Jun 03 15:03:51 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:51 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07" returned: 0 in 0.579s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-b99c5aee-a247-42ae-a1ca-d8528570ee07" released by "_copy_volume_from_snapshot" :: held 8.721s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-318f21a7-caf0-4f83-b41c-04651373df63-b99c5aee-a247-42ae-a1ca-d8528570ee07" released by "_create_volume_from_snapshot" :: held 8.760s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.789s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.797s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1740738114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a04e62-49e1-42ce-b595-97d9e38b0d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:44Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Creating volume 52a04e62-49e1-42ce-b595-97d9e38b0d39 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:51 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:51 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39 1073741824 Jun 03 15:03:51 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb391d0b-1dbb-497b-b67a-800eb1568347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b99c5aee-a247-42ae-a1ca-d8528570ee07', 'volume_size': 1, 'snapshot_id': '318f21a7-caf0-4f83-b41c-04651373df63'}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b129e03-7d6c-4a46-a4fc-0b712029b9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:51 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Volume volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 (b99c5aee-a247-42ae-a1ca-d8528570ee07): created successfully Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b129e03-7d6c-4a46-a4fc-0b712029b9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:51 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Flow 'volume_create_manager' (2286267c-64bb-428c-8c05-660a0aa6a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:51 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7c0cebbc-2ca1-418b-9576-66055b102056 tempest-SnapshotDependencyTests-452008653 None] Created volume successfully. Jun 03 15:03:52 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39 1073741824" returned: 0 in 0.847s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=149,cinder:UPDATE=181,cinder:INSERT=45,cinder:DELETE=17 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:52 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39 Jun 03 15:03:52 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "cinder-318f21a7-caf0-4f83-b41c-04651373df63-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-318f21a7-caf0-4f83-b41c-04651373df63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "cinder-quobyte-a4c21c12-a71a-472e-9372-e5b60a1e4598" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-a4c21c12-a71a-472e-9372-e5b60a1e4598" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "cinder-quobyte-318f21a7-caf0-4f83-b41c-04651373df63" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-318f21a7-caf0-4f83-b41c-04651373df63" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Deleting offline snapshot 318f21a7-caf0-4f83-b41c-04651373df63 of volume a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] snapshot_file for this snap is: volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e235eb8-aff7-404d-aef3-51c4b9d53aa8]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:52 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:52 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 Jun 03 15:03:52 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:53 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39" returned: 0 in 0.638s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.038s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1755764573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5760c4e1-46d2-4ac9-950f-67898d2fd4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:44Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Creating volume 5760c4e1-46d2-4ac9-950f-67898d2fd4f5 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:53 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf6d100-4185-4546-ab31-146d85e61f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a04e62-49e1-42ce-b595-97d9e38b0d39', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cdb83e-52d4-437c-b431-096f47e730ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:53 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5 1073741824 Jun 03 15:03:53 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:53 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume volume-52a04e62-49e1-42ce-b595-97d9e38b0d39 (52a04e62-49e1-42ce-b595-97d9e38b0d39): created successfully Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cdb83e-52d4-437c-b431-096f47e730ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (cc585a7e-f653-42cf-9c06-b5dd574692e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=183,cinder:SELECT=128,cinder:INSERT=48,cinder:DELETE=17 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:03:53 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a1d35747-b490-43cf-9298-a200cd2d82db tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created volume successfully. Jun 03 15:03:53 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63" returned: 0 in 0.787s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4c21c12-a71a-472e-9372-e5b60a1e4598(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[031a0615-e3eb-426a-a758-a79798c8df61]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:53 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 Jun 03 15:03:53 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:53 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:53 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:54 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5 1073741824" returned: 0 in 0.850s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:54 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5 Jun 03 15:03:54 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:54 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598" returned: 0 in 0.798s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:54 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.699s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 03 15:03:54 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 Jun 03 15:03:54 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:54 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5" returned: 0 in 0.654s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.079s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1283638563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40edcc3-e32b-4961-946a-b3970041fcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:45Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Creating volume e40edcc3-e32b-4961-946a-b3970041fcb2 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:54 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:54 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2 1073741824 Jun 03 15:03:54 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71ce9e7-0f73-487c-ba1c-553df266289d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e59fa36-47c9-4d89-a0f2-e4187ae0e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:54 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5 (5760c4e1-46d2-4ac9-950f-67898d2fd4f5): created successfully Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e59fa36-47c9-4d89-a0f2-e4187ae0e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (e959d722-8012-43ad-8bdf-3828d951b570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:54 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-a1fa9b0e-cf83-4427-9b80-c3c6b44f247f tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created volume successfully. Jun 03 15:03:55 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63" returned: 0 in 0.803s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:55 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63 Jun 03 15:03:55 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:55 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2 1073741824" returned: 0 in 0.891s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:55 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2 Jun 03 15:03:55 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:55 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:55 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598.318f21a7-caf0-4f83-b41c-04651373df63" returned: 0 in 0.637s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-318f21a7-caf0-4f83-b41c-04651373df63" released by "_delete_snapshot" :: held 3.149s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:55 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-a4c21c12-a71a-472e-9372-e5b60a1e4598" released by "delete_snapshot" :: held 3.178s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:55 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Created reservations ['cf05e4ee-5458-4254-a07b-fb40f87eeeb5', 'f4b327f9-cad7-4ef4-b346-fa34ffa9ee20', 'a4b81919-0c51-4ba1-bfd9-0927e85e816d', 'c1e08211-cb37-4346-9f52-a930e19983d4'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Delete snapshot completed successfully. Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-680a645e-0e0d-41a3-89bf-0ec9e44fe289 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-318f21a7-caf0-4f83-b41c-04651373df63-delete_snapshot" released by "delete_snapshot" :: held 3.339s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:56 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2" returned: 0 in 0.616s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.288s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1610132214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020cbea0-2907-42cc-8577-d432bc11a9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:45Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Creating volume 020cbea0-2907-42cc-8577-d432bc11a9ae {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:56 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76305238-4e3c-4963-894a-a739bb159068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40edcc3-e32b-4961-946a-b3970041fcb2', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:56 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae 1073741824 Jun 03 15:03:56 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200e4e29-1fd2-4447-87c5-84db741af172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:56 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume volume-e40edcc3-e32b-4961-946a-b3970041fcb2 (e40edcc3-e32b-4961-946a-b3970041fcb2): created successfully Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200e4e29-1fd2-4447-87c5-84db741af172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (b9aea2f6-b9d5-4635-8f71-fbe6acba9e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:56 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-7ee6b137-a690-4ea2-8588-0b138f2e2031 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created volume successfully. Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Flow 'volume_create_manager' (ff14e916-87b2-4838-8b7a-d09b3cccc547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc5c3c6-13ea-4b83-abd3-ab19444e1840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc5c3c6-13ea-4b83-abd3-ab19444e1840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693c51ed-937a-4101-8362-f7753ed1e8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09c9fcfb48d46b4b34a68f2609b4803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:57Z,use_quota=True,user_id='915bad28c54e45bda343c780e723e548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a941ac-e185-4b73-ada4-78831895d50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a941ac-e185-4b73-ada4-78831895d50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24931ffa-c3d5-45d2-be5f-0f88a12ce89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.image.glance [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Creating Keystone auth plugin from conf {{(pid=86614) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "cinder-a4c21c12-a71a-472e-9372-e5b60a1e4598-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:56 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-a4c21c12-a71a-472e-9372-e5b60a1e4598-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "cinder-quobyte-a4c21c12-a71a-472e-9372-e5b60a1e4598" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-a4c21c12-a71a-472e-9372-e5b60a1e4598" acquired by "delete_volume" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdaa733-a9f1-4d3f-a7f2-e64715b12bf7]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24931ffa-c3d5-45d2-be5f-0f88a12ce89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '693c51ed-937a-4101-8362-f7753ed1e8e7', 'volume_name': 'volume-693c51ed-937a-4101-8362-f7753ed1e8e7', 'volume_size': 1, 'image_id': '73ca1277-c640-4cc7-835b-babbd9761e92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73ca1277-c640-4cc7-835b-babbd9761e92', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe2132c7b3d9c1f6f7128d13ddd39f05', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b09c9fcfb48d46b4b34a68f2609b4803', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aa48751152e2ccb845cf9875be33c60b9a5b651de4979dda79998b9419b0637e37e3acffdc5c5146779fde7f0b098d81e325230827008676b0c6a02b35483c6d', 'id': '73ca1277-c640-4cc7-835b-babbd9761e92', 'created_at': datetime.datetime(2026, 6, 3, 13, 3, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73ca1277-c640-4cc7-835b-babbd9761e92/file', 'properties': {}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f99ef18-1870-4903-a76d-e3cf81be4132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f99ef18-1870-4903-a76d-e3cf81be4132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277b2ee4-a6eb-4510-aa9b-d638e18d2df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:57 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Volume 693c51ed-937a-4101-8362-f7753ed1e8e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-693c51ed-937a-4101-8362-f7753ed1e8e7', 'volume_size': 1, 'image_id': '73ca1277-c640-4cc7-835b-babbd9761e92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73ca1277-c640-4cc7-835b-babbd9761e92', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe2132c7b3d9c1f6f7128d13ddd39f05', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b09c9fcfb48d46b4b34a68f2609b4803', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aa48751152e2ccb845cf9875be33c60b9a5b651de4979dda79998b9419b0637e37e3acffdc5c5146779fde7f0b098d81e325230827008676b0c6a02b35483c6d', 'id': '73ca1277-c640-4cc7-835b-babbd9761e92', 'created_at': datetime.datetime(2026, 6, 3, 13, 3, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73ca1277-c640-4cc7-835b-babbd9761e92/file', 'properties': {}}, 'image_service': } Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Trying to clone 693c51ed-937a-4101-8362-f7753ed1e8e7 from image 73ca1277-c640-4cc7-835b-babbd9761e92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/73ca1277-c640-4cc7-835b-babbd9761e92', 'metadata': {}}]). {{(pid=86614) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 03 15:03:57 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 Jun 03 15:03:57 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 03 15:03:57 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Image download 0.00 MB at 0.00 MB/s Jun 03 15:03:57 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[5954c64c-0f9a-4134-bc67-1af734f5d85d]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae 1073741824" returned: 0 in 0.887s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:57 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae Jun 03 15:03:57 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:57 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD Jun 03 15:03:57 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:57 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598" returned: 0 in 0.754s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:57 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598 Jun 03 15:03:57 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:57 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:57 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD" returned: 0 in 0.670s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae" returned: 0 in 0.639s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.418s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1641457092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9408f3-84e3-4ab8-91ad-45e3bc323cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17b992422bc4a0081889f0cd87621b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:45Z,use_quota=True,user_id='1230a72e8c6347c395b051dcad8ee66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Creating volume 8c9408f3-84e3-4ab8-91ad-45e3bc323cff {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:03:57 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:57 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff 1073741824 Jun 03 15:03:57 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:57 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4845966b-f489-4904-a865-30162cfad7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020cbea0-2907-42cc-8577-d432bc11a9ae', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5c2f33-b31c-4528-8edf-a357e0477662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:58 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume volume-020cbea0-2907-42cc-8577-d432bc11a9ae (020cbea0-2907-42cc-8577-d432bc11a9ae): created successfully Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5c2f33-b31c-4528-8edf-a357e0477662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (4164049b-442d-4292-ad2a-3e17e4331b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:58 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD Jun 03 15:03:58 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:58 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-91104a52-344e-45ae-869f-f177d5bc99a3 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created volume successfully. Jun 03 15:03:58 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-a4c21c12-a71a-472e-9372-e5b60a1e4598" returned: 0 in 0.631s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-a4c21c12-a71a-472e-9372-e5b60a1e4598" released by "delete_volume" :: held 1.449s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Created reservations ['379805d9-cc49-4fdc-9e04-a1fd200f3039', '86c71f4f-e480-4d98-ae92-8174fc222bde', '3d4f0279-4078-4e21-a1b0-280f2aa12932', '540848e3-b490-4339-b4bb-1b5ccdd8fb7f'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:58 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD" returned: 1 in 0.708s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Temporary image 73ca1277-c640-4cc7-835b-babbd9761e92 is fetched for user 915bad28c54e45bda343c780e723e548. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 03 15:03:58 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:03:58 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0c6106-8b81-4a62-bb06-f456d455949e]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:58 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff 1073741824" returned: 0 in 0.851s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:58 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD Jun 03 15:03:58 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:58 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:58 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff Jun 03 15:03:58 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "cinder-b99c5aee-a247-42ae-a1ca-d8528570ee07-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-b99c5aee-a247-42ae-a1ca-d8528570ee07-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:59 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.657s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:03:59 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Deleted volume successfully. Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "cinder-quobyte-b99c5aee-a247-42ae-a1ca-d8528570ee07" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-2e372e9b-01ae-4bdf-bd30-bd401058cc86 tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-a4c21c12-a71a-472e-9372-e5b60a1e4598-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-b99c5aee-a247-42ae-a1ca-d8528570ee07" acquired by "delete_volume" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2449de3-2e17-4345-8130-ad8c00444ecd]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:59 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD" returned: 0 in 0.726s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:03:59 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 Jun 03 15:03:59 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:59 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff" returned: 0 in 0.688s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:03:59 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD Jun 03 15:03:59 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e5c1cf-2beb-4186-bbc0-3b33beb81914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ee6271-de6e-44d7-b871-d296cc3e62dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:03:59 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Volume volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff (8c9408f3-84e3-4ab8-91ad-45e3bc323cff): created successfully Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ee6271-de6e-44d7-b871-d296cc3e62dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:03:59 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Flow 'volume_create_manager' (cb6ef377-e8ce-47b8-bda6-b4dfb72b6444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:03:59 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-4c718fcc-f1f0-41b2-951e-a4ab0242e750 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created volume successfully. Jun 03 15:04:00 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07" returned: 0 in 0.729s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-8c9408f3-84e3-4ab8-91ad-45e3bc323cff-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:00 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07 Jun 03 15:04:00 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:00 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-8c9408f3-84e3-4ab8-91ad-45e3bc323cff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD" returned: 1 in 0.674s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693c51ed-937a-4101-8362-f7753ed1e8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09c9fcfb48d46b4b34a68f2609b4803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:03:57Z,use_quota=True,user_id='915bad28c54e45bda343c780e723e548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Creating volume 693c51ed-937a-4101-8362-f7753ed1e8e7 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:04:00 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:00 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 1073741824 Jun 03 15:04:00 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-quobyte-8c9408f3-84e3-4ab8-91ad-45e3bc323cff" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-8c9408f3-84e3-4ab8-91ad-45e3bc323cff" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e04a97-f653-425f-bdfc-fd9e5242bf21]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:00 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff Jun 03 15:04:00 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:00 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-b99c5aee-a247-42ae-a1ca-d8528570ee07" returned: 0 in 0.626s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-quobyte-b99c5aee-a247-42ae-a1ca-d8528570ee07" released by "delete_volume" :: held 1.395s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Created reservations ['19d13544-b074-4a00-8355-c7884b54b53b', 'e0d0792f-c7b5-4557-9d26-1584afb7d981', '488371d7-cba4-487c-83e0-38c3788e7a40', '3c844f86-2bd2-4907-8438-5bc1b4da0937'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:00 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:00 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:00 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff" returned: 0 in 0.730s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:00 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff Jun 03 15:04:00 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:00 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:00 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 1073741824" returned: 0 in 0.854s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:01 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 Jun 03 15:04:01 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:01 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.611s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:01 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Deleted volume successfully. Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-262aedcb-436a-4881-a980-eee479ae763f tempest-SnapshotDependencyTests-452008653 None] Lock "cinder-b99c5aee-a247-42ae-a1ca-d8528570ee07-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:01 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-8c9408f3-84e3-4ab8-91ad-45e3bc323cff" returned: 0 in 0.648s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-8c9408f3-84e3-4ab8-91ad-45e3bc323cff" released by "delete_volume" :: held 1.423s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created reservations ['e7624c27-cd3a-4b45-9cb2-ef998f108c08', '84b2fac0-a520-4a1a-8ce7-0802172fe4f6', 'd10a1273-71ce-4483-a75f-bf6e86587a3d', '644033e8-4843-482a-8b5f-b82cfd09964a'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:01 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7" returned: 0 in 0.661s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Attempting download of 73ca1277-c640-4cc7-835b-babbd9761e92 ((None, [{'url': 'file:///opt/stack/data/glance/images/73ca1277-c640-4cc7-835b-babbd9761e92', 'metadata': {}}])) to volume 693c51ed-937a-4101-8362-f7753ed1e8e7. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ec1d93-dc6e-444e-a82b-68a14e529739]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:01 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73ca1277-c640-4cc7-835b-babbd9761e92_c3c3_7f0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:01 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:01 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:01 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73ca1277-c640-4cc7-835b-babbd9761e92_c3c3_7f0 Jun 03 15:04:01 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-020cbea0-2907-42cc-8577-d432bc11a9ae-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-020cbea0-2907-42cc-8577-d432bc11a9ae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-quobyte-020cbea0-2907-42cc-8577-d432bc11a9ae" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-020cbea0-2907-42cc-8577-d432bc11a9ae" acquired by "delete_volume" :: waited 0.024s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[240625e2-6898-4f7f-8dcf-273bc4fa7ae9]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:02 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.752s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:02 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Deleted volume successfully. Jun 03 15:04:02 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73ca1277-c640-4cc7-835b-babbd9761e92_c3c3_7f0" returned: 0 in 0.759s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73ca1277-c640-4cc7-835b-babbd9761e92_c3c3_7f0 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:02 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-f4c36a9f-f559-43b2-9451-64851855032a tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-8c9408f3-84e3-4ab8-91ad-45e3bc323cff-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:02 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae Jun 03 15:04:02 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:02 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73ca1277-c640-4cc7-835b-babbd9761e92_c3c3_7f0 Jun 03 15:04:02 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:03 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73ca1277-c640-4cc7-835b-babbd9761e92_c3c3_7f0" returned: 1 in 0.713s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73ca1277-c640-4cc7-835b-babbd9761e92_c3c3_7f0' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:04:03 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffbe5ae-351f-4897-b210-85eb5209fdc2]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:03 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae" returned: 0 in 0.792s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:03 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae Jun 03 15:04:03 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:03 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD Jun 03 15:04:03 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:03 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-020cbea0-2907-42cc-8577-d432bc11a9ae" returned: 0 in 0.614s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:03 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-020cbea0-2907-42cc-8577-d432bc11a9ae" released by "delete_volume" :: held 1.469s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:03 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD" returned: 0 in 0.723s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:03 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created reservations ['86b2a6ec-676c-4811-b227-f4a92122efee', 'fe0c2cd8-2384-48d3-bfe8-6a78d0e3db78', 'c48127aa-ed73-496d-aecf-a0ac5bf936b9', 'ee385260-ce1a-428d-9997-3c29b5265d99'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:04 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:04 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:04 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD Jun 03 15:04:04 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-e40edcc3-e32b-4961-946a-b3970041fcb2-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-e40edcc3-e32b-4961-946a-b3970041fcb2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-quobyte-e40edcc3-e32b-4961-946a-b3970041fcb2" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-e40edcc3-e32b-4961-946a-b3970041fcb2" acquired by "delete_volume" :: waited 0.022s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[b221833d-43b9-4c62-a3c4-d70f012f17c1]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:04 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.912s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:04 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:04 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD" returned: 1 in 1.008s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:04:05 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] 73ca1277-c640-4cc7-835b-babbd9761e92 was raw, converting to raw {{(pid=86614) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 03 15:04:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:05 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Deleted volume successfully. Jun 03 15:04:05 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2 Jun 03 15:04:05 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:05 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-b2a7c480-323f-4df5-87ae-caa328efcb4c tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-020cbea0-2907-42cc-8577-d432bc11a9ae-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:05 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 Jun 03 15:04:05 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:05 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2" returned: 0 in 0.826s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:05 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2 Jun 03 15:04:05 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:05 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7" returned: 0 in 0.799s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:05 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73ca1277-c640-4cc7-835b-babbd9761e92_34t2_q4bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 {{(pid=86614) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 03 15:04:05 devstack cinder-volume[86614]: INFO cinder.image.image_utils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Converted 0.00 MB image at 0.00 MB/s Jun 03 15:04:05 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:05 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 1G Jun 03 15:04:05 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:06 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-e40edcc3-e32b-4961-946a-b3970041fcb2" returned: 0 in 0.621s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-e40edcc3-e32b-4961-946a-b3970041fcb2" released by "delete_volume" :: held 1.491s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created reservations ['ae686a5e-92b5-4d93-8d26-a537c6a0bfc4', '383b76d0-5ccb-4c5e-8ef3-7cead501293b', '009c05fc-86b0-46be-aa62-d362e676453d', 'b4b8eb2a-2062-43ae-8222-9db4df1315d6'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:06 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 1G" returned: 0 in 0.681s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[689b3ff2-fbd0-419a-bb93-2d1502d948df]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:06 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:06 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:06 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:06 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 Jun 03 15:04:06 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-5760c4e1-46d2-4ac9-950f-67898d2fd4f5-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-5760c4e1-46d2-4ac9-950f-67898d2fd4f5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-quobyte-5760c4e1-46d2-4ac9-950f-67898d2fd4f5" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:07 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-5760c4e1-46d2-4ac9-950f-67898d2fd4f5" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.722s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:07 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Deleted volume successfully. Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[146b1fa5-5a1c-4a67-ac16-d9c091d8035f]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-c825d24f-0efa-4cec-bc96-9f1d1f3cf645 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-e40edcc3-e32b-4961-946a-b3970041fcb2-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:07 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7" returned: 0 in 0.801s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:07 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:07 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5 Jun 03 15:04:07 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:07 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 Jun 03 15:04:07 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:08 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5" returned: 0 in 0.756s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:08 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5 Jun 03 15:04:08 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:08 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7" returned: 1 in 0.750s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Downloaded image 73ca1277-c640-4cc7-835b-babbd9761e92 ((None, [{'url': 'file:///opt/stack/data/glance/images/73ca1277-c640-4cc7-835b-babbd9761e92', 'metadata': {}}])) to volume 693c51ed-937a-4101-8362-f7753ed1e8e7 successfully. {{(pid=86614) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.image.image_utils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Temporary image 73ca1277-c640-4cc7-835b-babbd9761e92 for user 915bad28c54e45bda343c780e723e548 is deleted. {{(pid=86614) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.volume.volume_utils [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Marking volume 693c51ed-937a-4101-8362-f7753ed1e8e7 as bootable. {{(pid=86614) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Copying metadata from image 73ca1277-c640-4cc7-835b-babbd9761e92 to 693c51ed-937a-4101-8362-f7753ed1e8e7. {{(pid=86614) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Creating volume glance metadata for volume 693c51ed-937a-4101-8362-f7753ed1e8e7 backed by image 73ca1277-c640-4cc7-835b-babbd9761e92 with: {'image_id': '73ca1277-c640-4cc7-835b-babbd9761e92', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fe2132c7b3d9c1f6f7128d13ddd39f05', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86614) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277b2ee4-a6eb-4510-aa9b-d638e18d2df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693c51ed-937a-4101-8362-f7753ed1e8e7', 'volume_size': 1, 'image_id': '73ca1277-c640-4cc7-835b-babbd9761e92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73ca1277-c640-4cc7-835b-babbd9761e92', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe2132c7b3d9c1f6f7128d13ddd39f05', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b09c9fcfb48d46b4b34a68f2609b4803', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aa48751152e2ccb845cf9875be33c60b9a5b651de4979dda79998b9419b0637e37e3acffdc5c5146779fde7f0b098d81e325230827008676b0c6a02b35483c6d', 'id': '73ca1277-c640-4cc7-835b-babbd9761e92', 'created_at': datetime.datetime(2026, 6, 3, 13, 3, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 13, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73ca1277-c640-4cc7-835b-babbd9761e92/file', 'properties': {}}, 'image_service': }' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0abeb2-1fb5-41e8-b85d-f32a59e62cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:08 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Volume volume-693c51ed-937a-4101-8362-f7753ed1e8e7 (693c51ed-937a-4101-8362-f7753ed1e8e7): created successfully Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0abeb2-1fb5-41e8-b85d-f32a59e62cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Flow 'volume_create_manager' (ff14e916-87b2-4838-8b7a-d09b3cccc547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:04:08 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-f4bc503a-adaf-4440-bc14-ca9ebc4111e6 tempest-VolumeImageDependencyTests-1475971728 None] Created volume successfully. Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Acquiring lock "cinder-693c51ed-937a-4101-8362-f7753ed1e8e7-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Lock "cinder-693c51ed-937a-4101-8362-f7753ed1e8e7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Acquiring lock "cinder-quobyte-693c51ed-937a-4101-8362-f7753ed1e8e7" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Lock "cinder-quobyte-693c51ed-937a-4101-8362-f7753ed1e8e7" acquired by "delete_volume" :: waited 0.026s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[51490255-c410-4ed0-ac10-83e14f3a1d87]: (4, 'raw') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:08 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-5760c4e1-46d2-4ac9-950f-67898d2fd4f5" returned: 0 in 0.739s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-5760c4e1-46d2-4ac9-950f-67898d2fd4f5" released by "delete_volume" :: held 1.555s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created reservations ['5b1cc564-f63a-4904-ac7e-576bc6da03b5', '1a0c2c43-ab9f-4bff-81b8-1d117b7d915a', '008706f2-e131-42dc-b8e3-5c14a96ab7f2', '73684cfe-1e21-4495-ab6f-356a4d25d1f3'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:08 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 Jun 03 15:04:08 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:08 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:08 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:08 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-52a04e62-49e1-42ce-b595-97d9e38b0d39-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-52a04e62-49e1-42ce-b595-97d9e38b0d39-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-quobyte-52a04e62-49e1-42ce-b595-97d9e38b0d39" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-52a04e62-49e1-42ce-b595-97d9e38b0d39" acquired by "delete_volume" :: waited 0.025s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa24c13d-f754-479e-8c5e-43d7f6a06630]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:09 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7" returned: 0 in 0.804s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:09 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39 Jun 03 15:04:09 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:09 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:09 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.792s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:09 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:09 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Deleted volume successfully. Jun 03 15:04:09 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-941d06ce-eca4-4fe1-abfd-e9d241860298 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-5760c4e1-46d2-4ac9-950f-67898d2fd4f5-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:10 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39" returned: 0 in 0.760s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:10 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39 Jun 03 15:04:10 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:10 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7" returned: 1 in 0.821s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7' failed. Not Retrying. {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 15:04:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:10 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7 Jun 03 15:04:10 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:10 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:10 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-52a04e62-49e1-42ce-b595-97d9e38b0d39" returned: 0 in 0.683s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:10 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-52a04e62-49e1-42ce-b595-97d9e38b0d39" released by "delete_volume" :: held 1.503s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created reservations ['10379a2c-71ee-4c77-9158-06043a60c13c', 'eda5a264-6b58-4ff2-a41e-686bb9e58d95', 'aeaf5a23-af6e-4c1a-9519-6524cc3962c4', '08f63d98-d9be-4ead-8472-61df63f8835b'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:11 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-693c51ed-937a-4101-8362-f7753ed1e8e7" returned: 0 in 0.739s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:11 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Lock "cinder-quobyte-693c51ed-937a-4101-8362-f7753ed1e8e7" released by "delete_volume" :: held 2.451s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:11 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Created reservations ['5280c876-0f8a-44d6-929a-cce9f2bc83f9', '08511ed1-a8f6-4c13-b083-5d26c0937c9a', 'b9aa6286-c8be-4ce8-9249-74b482a9710a', '9a032eaa-43cd-4b42-bfbc-3244e213a198'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:11 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:11 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-4fd0f096-fc5b-4a38-a788-cc8d33c38e28-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-4fd0f096-fc5b-4a38-a788-cc8d33c38e28-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "cinder-quobyte-4fd0f096-fc5b-4a38-a788-cc8d33c38e28" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-4fd0f096-fc5b-4a38-a788-cc8d33c38e28" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[deec0ecb-c2b6-49e2-b897-5e5ed7ecd42a]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:11 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.633s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:11 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Deleted volume successfully. Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-35e57194-dd97-44d6-9bd2-79b2db1902fc tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-52a04e62-49e1-42ce-b595-97d9e38b0d39-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:11 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28 Jun 03 15:04:11 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:11 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.661s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:11 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Deleted volume successfully. Jun 03 15:04:11 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-8413d591-5960-4f03-a65e-58b0c699e863 tempest-VolumeImageDependencyTests-1475971728 None] Lock "cinder-693c51ed-937a-4101-8362-f7753ed1e8e7-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:12 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28" returned: 0 in 0.744s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:12 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:12 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28 Jun 03 15:04:12 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:13 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-4fd0f096-fc5b-4a38-a788-cc8d33c38e28" returned: 0 in 0.614s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-quobyte-4fd0f096-fc5b-4a38-a788-cc8d33c38e28" released by "delete_volume" :: held 1.408s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Created reservations ['b8711556-b587-4a18-9471-6442b0b0e16b', '8d829a64-ebc6-4934-9e96-b185a9d56ee7', '33bbe2f8-7244-4f95-a27e-27e25519dfc3', 'cd08de0c-4bac-4445-b56a-927d99661104'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:13 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:13 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:13 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.613s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:13 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Deleted volume successfully. Jun 03 15:04:13 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-53127923-8e01-4acb-96a2-7c92f9680737 tempest-CreateVolumesFromSourceVolumeTest-2077490899 None] Lock "cinder-4fd0f096-fc5b-4a38-a788-cc8d33c38e28-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Flow 'volume_create_manager' (11c4ee8e-7782-4860-8bd2-0f8af8393d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c660ad4c-ab86-4022-8d94-8c22839b4720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c660ad4c-ab86-4022-8d94-8c22839b4720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7f11f6-5b8c-4aab-8351-a7acb980da29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='773d2290945a4ebebd8d622002f865a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:04:16Z,use_quota=True,user_id='82e682cd87f84ecab97a34869c748a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b457e96-823f-4c1a-b20d-fa585916acf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b457e96-823f-4c1a-b20d-fa585916acf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9727bdd8-9d66-4022-9805-f9e5ce082ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9727bdd8-9d66-4022-9805-f9e5ce082ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7f11f6-5b8c-4aab-8351-a7acb980da29', 'volume_name': 'volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68fa2b6-4f12-4567-9f3b-dacdbbf934cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68fa2b6-4f12-4567-9f3b-dacdbbf934cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8804fdb1-554e-4fdc-aedd-a22da6e5cba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:16 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Volume 7f7f11f6-5b8c-4aab-8351-a7acb980da29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29', 'volume_size': 1} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7f11f6-5b8c-4aab-8351-a7acb980da29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='773d2290945a4ebebd8d622002f865a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:04:16Z,use_quota=True,user_id='82e682cd87f84ecab97a34869c748a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Creating volume 7f7f11f6-5b8c-4aab-8351-a7acb980da29 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:04:16 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:04:16 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:16 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29 1073741824 Jun 03 15:04:16 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:17 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29 1073741824" returned: 0 in 0.737s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:17 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29 Jun 03 15:04:17 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:17 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29" returned: 0 in 0.585s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:17 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:04:17 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8804fdb1-554e-4fdc-aedd-a22da6e5cba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6c1314-c679-4800-8028-e0b74ac745a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:17 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Volume volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29 (7f7f11f6-5b8c-4aab-8351-a7acb980da29): created successfully Jun 03 15:04:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6c1314-c679-4800-8028-e0b74ac745a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:17 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Flow 'volume_create_manager' (11c4ee8e-7782-4860-8bd2-0f8af8393d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:04:17 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-0e10f713-13ee-45ec-a44a-bf1b70e6eb48 tempest-CinderUnicodeTest-1503971101 None] Created volume successfully. Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.flows.manager.create_volume [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86614) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Flow 'volume_create_manager' (68bbbe2b-5614-4bab-ac25-48796e9fdf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6277cf30-810b-4911-984b-b8a8ccff40a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6277cf30-810b-4911-984b-b8a8ccff40a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:04:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1880867537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='773d2290945a4ebebd8d622002f865a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:04:19Z,use_quota=True,user_id='82e682cd87f84ecab97a34869c748a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cae2e8f-2857-44dc-8262-ec6295408562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cae2e8f-2857-44dc-8262-ec6295408562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ac3d92-229d-418c-ab7f-09af33ca45de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ac3d92-229d-418c-ab7f-09af33ca45de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5', 'volume_name': 'volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (237b74de-6d60-45c2-ba57-54222bd4aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (237b74de-6d60-45c2-ba57-54222bd4aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da591f3b-a4ff-45ac-93f6-3b5179dfe150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:18 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Volume 9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5', 'volume_size': 1} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T13:04:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1880867537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='773d2290945a4ebebd8d622002f865a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T13:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T13:04:19Z,use_quota=True,user_id='82e682cd87f84ecab97a34869c748a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b1e525-ca93-4b02-b8b3-3cf09ba98aa0),volume_type_id=11b1e525-ca93-4b02-b8b3-3cf09ba98aa0)}" {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Creating volume 9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 {{(pid=86614) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Selected osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 as target Quobyte volume. {{(pid=86614) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 15:04:18 devstack cinder-volume[86614]: INFO cinder.volume.drivers.remotefs [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] casted to osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33 Jun 03 15:04:18 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 1073741824 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:18 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 1073741824 Jun 03 15:04:18 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:19 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 1073741824" returned: 0 in 0.734s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:19 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:19 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 Jun 03 15:04:19 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:20 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" returned: 0 in 0.580s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:20 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'} {{(pid=86614) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 03 15:04:20 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da591f3b-a4ff-45ac-93f6-3b5179dfe150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5', 'volume_size': 1}' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb88226-1b55-4e79-aa86-12a25a2996de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 15:04:20 devstack cinder-volume[86614]: INFO cinder.volume.flows.manager.create_volume [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Volume volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 (9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5): created successfully Jun 03 15:04:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb88226-1b55-4e79-aa86-12a25a2996de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86614) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 15:04:20 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Flow 'volume_create_manager' (68bbbe2b-5614-4bab-ac25-48796e9fdf4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86614) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 15:04:20 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-789c1454-1f21-4b0d-b05f-6fe5c897b9f1 tempest-CinderUnicodeTest-1503971101 None] Created volume successfully. Jun 03 15:04:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:21 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Creating offline snapshot 927d4481-ec57-4152-8d4b-678b61ab7693 of volume 9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 {{(pid=86614) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 03 15:04:21 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[32311d0f-8786-4dbe-8c3b-f202c5c9fb83]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:21 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 Jun 03 15:04:21 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:21 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" returned: 0 in 0.665s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:21 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 1G {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:21 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 1G Jun 03 15:04:21 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:22 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 1G" returned: 0 in 0.719s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:22 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:22 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 Jun 03 15:04:22 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:23 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 -F qcow2 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693" returned: 0 in 0.614s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:23 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 is being set with open permissions: ugo+rw Jun 03 15:04:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:23 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 Jun 03 15:04:23 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:23 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693" returned: 0 in 0.559s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:23 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:23 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.info Jun 03 15:04:23 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:24 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.info" returned: 0 in 0.564s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:24 devstack cinder-volume[86614]: WARNING cinder.volume.drivers.remotefs [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.info is being set with open permissions: ugo+rw Jun 03 15:04:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.info {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:24 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.info Jun 03 15:04:24 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:24 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.info" returned: 0 in 0.569s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:24 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.772s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:24 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-d7efbd77-2881-4faf-9142-044f09e9bf8c tempest-CinderUnicodeTest-1503971101 None] Create snapshot completed successfully Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "cinder-927d4481-ec57-4152-8d4b-678b61ab7693-delete_snapshot" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-927d4481-ec57-4152-8d4b-678b61ab7693-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "cinder-quobyte-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" by "delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-quobyte-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "cinder-quobyte-927d4481-ec57-4152-8d4b-678b61ab7693" by "_delete_snapshot" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-quobyte-927d4481-ec57-4152-8d4b-678b61ab7693" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Deleting offline snapshot 927d4481-ec57-4152-8d4b-678b61ab7693 of volume 9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] snapshot_file for this snap is: volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 {{(pid=86614) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3d1f40-ef50-4f0e-97fa-dc46721cac4d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:25 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 Jun 03 15:04:25 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:25 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693" returned: 0 in 0.692s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:25 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.remotefs [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86614) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 15:04:26 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[57049b83-b9e9-4ac3-b356-82e7f9293492]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:26 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 Jun 03 15:04:26 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:26 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" returned: 0 in 0.684s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:26 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:26 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 Jun 03 15:04:26 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:27 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693" returned: 0 in 0.664s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:27 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693 Jun 03 15:04:27 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:27 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:27 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5.927d4481-ec57-4152-8d4b-678b61ab7693" returned: 0 in 0.585s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-quobyte-927d4481-ec57-4152-8d4b-678b61ab7693" released by "_delete_snapshot" :: held 2.722s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:27 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-quobyte-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" released by "delete_snapshot" :: held 2.744s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:28 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Created reservations ['ead76d67-1b13-42c5-adc3-e251f4341516', '2c0ee5f9-fdb3-4f06-b8ac-fa59a59d64bc', 'cc090c78-28c1-4fd5-b6d2-e99435e7a9af', '4e960ba4-6d43-4aa0-848c-6ebc263c63e2'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:28 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Delete snapshot completed successfully. Jun 03 15:04:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-162afc51-c4f4-47a9-89bc-5e67e08d8b27 tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-927d4481-ec57-4152-8d4b-678b61ab7693-delete_snapshot" released by "delete_snapshot" :: held 2.860s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "cinder-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "cinder-quobyte-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:28 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-quobyte-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" acquired by "delete_volume" :: waited 0.014s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:28 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[7830db5d-6076-4b48-9f6a-1d7f47f7c38d]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:28 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:28 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 Jun 03 15:04:28 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:29 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" returned: 0 in 0.686s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:29 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5 Jun 03 15:04:29 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:29 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" returned: 0 in 0.586s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-quobyte-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5" released by "delete_volume" :: held 1.325s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Created reservations ['23a87e05-f3df-41db-9d86-4b027d4b97ae', '39e8dd25-7b9f-4d5e-a54b-5914681b6ae4', '75714fac-866c-403d-8242-95c764f38011', 'a47fb74e-8a4a-4588-a746-57ddf0013578'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:29 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:29 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:29 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:30 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.572s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:30 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:30 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Deleted volume successfully. Jun 03 15:04:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-e8f96a99-b110-4eb1-bf66-d28ef5c1894f tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-9bc5ec71-e7bd-4adf-9d1c-283ce2747dd5-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "cinder-7f7f11f6-5b8c-4aab-8351-a7acb980da29-delete_volume" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-7f7f11f6-5b8c-4aab-8351-a7acb980da29-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "cinder-quobyte-7f7f11f6-5b8c-4aab-8351-a7acb980da29" by "delete_volume" {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 15:04:30 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-quobyte-7f7f11f6-5b8c-4aab-8351-a7acb980da29" acquired by "delete_volume" :: waited 0.018s {{(pid=86614) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 15:04:30 devstack cinder-volume[86614]: DEBUG oslo.privsep.daemon [-] privsep: reply[425d1e42-bb0f-4359-b7fe-1d0cba252e7e]: (4, 'qcow2') {{(pid=87576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 15:04:30 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:30 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29 Jun 03 15:04:30 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:31 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29" returned: 0 in 0.685s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:31 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29 Jun 03 15:04:31 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:31 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:31 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99/volume-7f7f11f6-5b8c-4aab-8351-a7acb980da29" returned: 0 in 0.585s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:31 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-quobyte-7f7f11f6-5b8c-4aab-8351-a7acb980da29" released by "delete_volume" :: held 1.309s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:32 devstack cinder-volume[86614]: DEBUG cinder.quota [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Created reservations ['faa94a93-580a-48ae-bf63-8db8e759d691', '768c3d17-ffb1-4ade-8e61-0650249b7dc7', 'd45c7441-abe0-4963-be51-1b1cb8477278', 'af46c63b-b045-4591-a5cb-9421f0a6c397'] {{(pid=86614) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 15:04:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:32 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:32 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:32 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:32 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:32 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.574s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:32 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:32 devstack cinder-volume[86614]: INFO cinder.volume.manager [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Deleted volume successfully. Jun 03 15:04:32 devstack cinder-volume[86614]: DEBUG cinder.coordination [None req-37e3b120-6d85-4cc1-86bc-7581b82c36a3 tempest-CinderUnicodeTest-1503971101 None] Lock "cinder-7f7f11f6-5b8c-4aab-8351-a7acb980da29-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=86614) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 15:04:42 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:SELECT=79,cinder:INSERT=34,cinder:UPDATE=124,cinder:DELETE=9 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:04:43 devstack cinder-volume[86614]: DEBUG dbcounter [-] [86614] Writing DB stats cinder:UPDATE=121,cinder:DELETE=11,cinder:SELECT=92,cinder:INSERT=35 {{(pid=86614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 15:04:53 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 15:04:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 15:04:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 15:04:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33': None} {{(pid=86614) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 15:04:53 devstack cinder-volume[86614]: DEBUG cinder.volume.drivers.quobyte [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22777cad-e293-4486-b4e3-a9b316848d33'] {{(pid=86614) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 15:04:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.lockutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86614) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 15:04:53 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 15:04:53 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99 Jun 03 15:04:53 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 15:04:54 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jun 03 15:04:54 devstack cinder-volume[86614]: DEBUG oslo_concurrency.processutils [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8912aca7b9e0a4f2fb72d844e3a99" returned: 0 in 0.581s {{(pid=86614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 15:04:54 devstack cinder-volume[86614]: DEBUG cinder.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Notifying Schedulers of capabilities ... {{(pid=86614) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 03 15:04:54 devstack cinder-volume[86614]: DEBUG oslo_service.periodic_task [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] Running periodic task VolumeManager._thread_info {{(pid=86614) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 15:04:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread count: 28 {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 03 15:04:54 devstack cinder-volume[86614]: DEBUG cinder.volume.manager [None req-e100eb7d-6f92-40eb-99d3-bc7890fdfc76 None None] thread info: [<_MainThread(MainThread, started 135003918086272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86614) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}